[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: multiple commands in one pass of data
From: |
John Darrington |
Subject: |
Re: multiple commands in one pass of data |
Date: |
Tue, 10 Aug 2010 12:53:46 +0000 |
User-agent: |
Mutt/1.5.18 (2008-05-17) |
On Tue, Aug 10, 2010 at 08:04:00AM -0400, la wrote:
Setting maxwarns to a large number presents a different problem. My file
is
well over 255 million records and pspp generates a error statement for each
record/variable that contains blanks if it's defined as numeric. So the
pspp
would generate an enormous report.
I tried using SET BLANKS=0 or other data transformation to convert blanks
to
0 within my pspp syntax file but it seems that the error is generated as
soon as it reads the data before anything else happens. Does this mean
that
I have to first process the file outside of pspp to convert blanks to 0?
Probably it does :( Until the MXWARNS issue is fixed, I suggest you work
around this with a fifo. Something similar to
mkfifo mypipe; sed -e 's/ */0 /g' datafile > mypipe
Then you can instruct pspp to read from the fifo: DATA LIST FILE='mypipe' ...
Hope this helps.
--
PGP Public key ID: 1024D/2DE827B3
fingerprint = 8797 A26D 0854 2EAB 0285 A290 8A67 719C 2DE8 27B3
See http://pgp.mit.edu or any PGP keyserver for public key.
signature.asc
Description: Digital signature
Re: multiple commands in one pass of data, Ben Pfaff, 2010/08/05