|
From: | David Rosenberg |
Subject: | Re: Use R to manage results from GNU Parallel |
Date: | Sun, 5 Jan 2014 12:02:46 -0500 |
>> load_parallel_results_split_to_columns(filenametable)parallel --results my/results/dir --header : echo FOO={foo}
>
> I'm happy to write these, though I'm limited on time. Could you could write
> a generator for test data?
BAR={bar}';'seq {bar} :::: <(echo foo; seq 1000) <(echo bar; seq 10)
I do not like the idea of shelling out simply to read a file. If we
are talking tons of small files then spawning a shell will slow it
down tremendously.
I read that anything you can do on a connection (i.e. R's filehandle)
you can also do on a string using textConnection. So I would suggest
we make an efficient raw reader and use that and then use
a=sub(newlinesep,"\n",a) to replace newline/tab and finally use R's
builtin reader on a textConnection.
[Prev in Thread] | Current Thread | [Next in Thread] |