Re: Lisp Serialization: GZ support?

[Paul Johnson]

Thanks for the tip leading to:
-storeAsDataset:typeName:type:rank:dims:ptr:.

I can use that to write out an hdf5 dataset by adding the hdf5OutDeep: 
method. I updated my post of serialization1.m:

http://lark.cc.ukans.edu/~pauljohn/SwarmFaq/WorkingExampleCode/objc/serialization1.m

I need an equivalent of "lispOutVars:" to shallow archive the ints and 
doubles in the Data object. I made some guesses, none satisfactory.

I doubt I'm doing the rest of this correctly. The hdf5 output dataset is 
about 12 times bigger than the size of the *.scm file from the Lisp 
archiver and I can't get the hdf5 version of the program to re-load the 
saved-arrays.

Reload crashes Swarm like so. I did not do any special hdf5In code. 
Should I?

(gdb) bt
#0  0x4076628f in chunk_free (ar_ptr=0x40819b80, p=0xffffff90) at 
malloc.c:3225
#1  0x40765ff4 in __libc_free (mem=0x80ca5d8) at malloc.c:3154
#2  0x4051c352 in H5MM_xfree () from /usr/lib/libhdf5.so.0
#3  0x404e0f7c in H5A_read () from /usr/lib/libhdf5.so.0
#4  0x404e0b8d in H5Aread () from /usr/lib/libhdf5.so.0
#5  0x401f18f7 in get_attribute_string_list (oid=805306368, 
attrName=0x40218fb5 "type",
    strings=0xbffff268)
    at 
/home/pauljohn/LinuxDownloads/redhat/BUILD/swarm-2.1.132.20020309/src/defobj/HDF5Object.m:219
#6  0x401f1c15 in get_attribute (oid=805306368, attrName=0x40218fb5 "type")
    at 
/home/pauljohn/LinuxDownloads/redhat/BUILD/swarm-2.1.132.20020309/src/defobj/HDF5Object.m:261
#7  0x401ffaeb in hdf5In (aZone=0x807e2a0, hdf5Obj=0x80c8ff8)
    at 
/home/pauljohn/LinuxDownloads/redhat/BUILD/swarm-2.1.132.20020309/src/defobj/defobj.m:329
#8  0x401e9462 in _i_HDF5Archiver_c__getWithZone_key_ (self=0x80bd748, 
_cmd=0x40220308,
    aZone=0x807e2a0, key=0x8049742 "myCollection")
    at 
/home/pauljohn/LinuxDownloads/redhat/BUILD/swarm-2.1.132.20020309/src/defobj/HDF5Archiver.m:198
#9  0x401e94e9 in _i_HDF5Archiver_c__getObject_ (self=0x80bd748, 
_cmd=0x804ada8,
    key=0x8049742 "myCollection")
    at 
/home/pauljohn/LinuxDownloads/redhat/BUILD/swarm-2.1.132.20020309/src/defobj/HDF5Archiver.m:211
#10 0x08049564 in main (argc=1, argv=0xbffff414) at serialization1.m:275
#11 0x40701627 in __libc_start_main (main=0x8049428 <main>, argc=1, 
ubp_av=0xbffff414,
    init=0x80488b4 <_init>, fini=0x80495f8 <_fini>, 
rtld_fini=0x4000dcc4 <_dl_fini>,
    stack_end=0xbffff40c) at ../sysdeps/generic/libc-start.c:129


Marcus G. Daniels wrote:
> PJ> The hang-ups I've got with hdf5 output are
> PJ> 1. Can't save dynamically allocated arrays of ints and doubles
>
> Along the same lines of naming variables in a [obj lispOutDeep:
> stream] methods, the method that you'd send to the hdf5Obj in a [obj
> hdf5OutDeep: hdf5Obj] is -storeAsDataset:typeName:type:rank:dims:ptr:.
>
> The first argument would be the ivar name, the second can be NULL,
> the third would be fcall_type_double (in the case of a double floating
> point variable), the fourth the number of dimensions in the array, the
> fifth the size of each dimension, and the last the pointer to the
> dynamically allocated array.
>
>                   ==================================
>    Swarm-Support is for discussion of the technical details of the day
>    to day usage of Swarm.  For list administration needs (esp.
>    [un]subscribing), please send a message to <address@hidden>
>    with "help" in the body of the message.



--
Paul E. Johnson                       email: address@hidden
Dept. of Political Science            http://lark.cc.ku.edu/~pauljohn
University of Kansas                  Office: (785) 864-9086
Lawrence, Kansas 66045                FAX: (785) 864-5700


                 ==================================
  Swarm-Support is for discussion of the technical details of the day
  to day usage of Swarm.  For list administration needs (esp.
  [un]subscribing), please send a message to <address@hidden>
  with "help" in the body of the message.