polymetric music - barlines in wrong places

[Michael Meixner]

Hello fellow lilyponders,

while trying to set a polymetric piece (Dufay) I ran into a problem.
Please try the following snippet - I get barlines after the whole note, 
and after ONE quarter, and then 
the counting seems to be ok for the rest 
(as if I had written \time 4/4 c1 \time 1/4 c4 \time 4/4 c c c ...)
What am I overlooking?

% ========

\version "2.9.5"

\layout { ragged-right=##t }

     \new Score \with {
       \remove "Timing_translator"
       \remove "Default_bar_line_engraver"
        }{
         <<
         \new Staff \with {
                \consists "Timing_translator"
                \consists "Default_bar_line_engraver"
                }{
       
                        \relative c'' {         
                        \time 4/4
                        c1 
                        c4 c c c 
                        c c c c 
                        }
                }

                >>
                }

% =========