Re: [Gluster-devel] [Gluster-users] Peers rejected, broken setup

[Vijay Bellur]

On 09/26/2013 12:45 AM, Nux! wrote:
> On 25.09.2013 18:24, Vijay Bellur wrote:
> > On 09/25/2013 08:50 PM, Nux! wrote:
> > > On 25.09.2013 15:42, Nux! wrote:
> > > > Hello,
> > > >
> > > > I'm currently using 4 servers with various types of volumes on them,
> > > > today I noticed 2 of them report the other 2 as "peer rejected" and
> > > > viceversa.
> > > > Where do I even begin to debug this? I don't see anything meaningful
> > > > in the logs.
> > > > Any pointers?
> >
> > "Peer rejected" is seen if there is a volume configuration mismatch
> > between peers. Can you check if there is a mismatch in volume
> > configuration between the two sets of peers?
>
> I have checked the volumes "info" files following Krishnan's advice and
> they seem to have the same data, though oddly not exactly in the same
> place, e.g. some have auth.allow above rpc.auth-allow and it's
> counterpart info files from other servers have it the other way around,
> but the values are identical. Aren't these files supposed to be 100% the
> same?

The ordering need not be the same. Can you please verify if there's a 
difference in the content of this file on all peers:

/var/lib/glusterd/vols/<volname>/cksum

Thanks,
Vijay

> Other than this, the volume files on all servers have port=0 for the
> bricks that are on the "rejected" peers.
>
> So it's hard to say which is the "right" set of servers and on which I
> should execute the instructions from
> http://www.gluster.org/community/documentation/index.php/Resolving_Peer_Rejected
>
>
> I'm afraid not to make this even a bigger disaster.
>
> Suggestions?