[bug-gawk] Memory leak

[Stephane Delsert]

Hi,

 

We hit a memory leak with gawk for the joined script. This script sorts a file already sorted on primary keys for additional keys. For achieve this I used a user defined function and set this function as follow :the  PROCINFO["sorted_in"]="__sort_subsort"

We noticed a growth of memory required by gawk with the increase of the processed records. Gawk  ended after over 320 MM of records. The memory size was over 20Gb. A post analysis shown that the maximum size of the tables of the script was 121 elements.

I made different tests and it appears that this issue doesn’t arrive when I don’t use PROCINFO mechanism. For little files, this script works correctly.

 

I didn’t see this kind of bug in the bug reports. I made tests with version 4.1.3 and version 4.1.4 without success.

 

Thank you for your help.

 

Best regards,

 

Stéphane Delsert.

 

***************************************************************************
The information contained in this communication is confidential, is
intended only for the use of the recipient named above, and may be legally
privileged.

If the reader of this message is not the intended recipient, you are
hereby notified that any dissemination, distribution or copying of this
communication is strictly prohibited.

If you have received this communication in error, please resend this
communication to the sender and delete the original message or any copy
of it from your computer system.

Thank You.
****************************************************************************

test.awk
Description: test.awk