Re: uniq without sort <-------------- GURU NEEDED

[Thierry Volpiatto]

gnuist006@gmail.com writes:

> This is a tough problem, and needs a guru.
>
> I know it is very easy to find uniq or non-uniq lines if you scramble
> all of them and sort them. Its trivially
>
> echo -e "a\nc\nd\nb\nc\nd" | sort | uniq
>
> $ echo -e "a\nc\nd\nb\nc\nd"
> a
> c
> d
> b
> c
> d
>
> $ echo -e "a\nc\nd\nb\nc\nd"|sort|uniq
> a
> b
> c
> d
>
>
> So it is TRIVIAL with sort.
>
> I want uniq without sorting the initial order.
>
> The algorithm is this. For every line, look above if there is another
> line like it. If so, then ignore it. If not, then output it. I am
> sure, I can spend some time to write this in C. But what is the
> solution using shell ? This way I can get an output that preserves the
> order of first occurrence. It is needed in many problems.

Here in python but the same can be done in lisp or shell

In [13]: B = ["a", "c", "d", "b", "e", "a", "d", "e"]

In [14]: A = []

In [15]: for i in B:
   ....:     if i not in A: A.append(i)
   

In [16]: A

Out[16]: ['a', 'c', 'd', 'b', 'e']

-- 
A + Thierry
Pub key: http://pgp.mit.edu