Re: [O] Very slow performance in Org-mode on 10k line file?

[John Hendy]

On Wed, Aug 7, 2013 at 5:12 PM, Russell Adams <address@hidden> wrote:
> John,
>
> I have a 17,000 file I work out of constantly in Org 7.8.10 with very
> little lag. Just another data point.

Is it inconvenient for you to git pull and try on Org 8.0 to see if
there's any difference?

John

>
> Thanks.
>
> On Wed, Aug 07, 2013 at 05:06:51PM -0500, John Hendy wrote:
>> Just an update:
>> - I reverted back to commit release_8.0.2-73-g9998f2 (early May) with
>> no change in behavior, so perhaps it wasn't anything other than
>> growing file size
>> - I just created archive files for work journal entries in 2011 and
>> 2012, storing them in separate archive files
>> - I'm now down to ~6500 lines, and lag is unnoticeable
>>
>> Perhaps there's some magical cutoff between 6,000 and 10,000 lines
>> that starts to really bog things down?
>>
>>
>>
>> John
>>
>> On Wed, Aug 7, 2013 at 4:47 PM, John Hendy <address@hidden> wrote:
>> > On Wed, Aug 7, 2013 at 4:39 PM, Rainer Stengele
>> > <address@hidden> wrote:
>> >> Am 07.08.2013 22:25, schrieb John Hendy:
>> >>> Greetings,
>> >>>
>> >>>
>> >>> I just started experiencing major lag in Org-mode on my main work
>> >>> notes file, which is at about 10k lines. Is that getting up to the
>> >>> point where files get unwieldy? In googling around, I found a few
>> >>> suggestions:
>> >>>
>> >>> - Fiddle with linum settings
>> >>> http://stackoverflow.com/questions/5229705/emacs-org-mode-turn-off-line-numbers
>> >>>
>> >>> I set linum-eager to off and linum-delay to on for the current setting
>> >>> via the customize interface and didn't perceive an effect. Any
>> >>> keystroke in my org file takes 1-2 seconds to appear.
>> >>>
>> >>> - Fontification?
>> >>> http://comments.gmane.org/gmane.emacs.orgmode/45197
>> >>>
>> >>> Comments there have files in the 5-137k line range and many say
>> >>> there's no/little lag unless running agenda commands.
>> >>>
>> >>> Any other suggestions? I use this file almost daily, mostly for
>> >>> reference, not adding... that's to say it hasn't grown majorly in the
>> >>> past even 3months (maybe a few hundred lines), but performance
>> >>> *definitely* wasn't anything like this until the last week or so.
>> >>>
>> >>> Thanks for any suggestions on improving or tracking down the source.
>> >>> In the mean time, I'm going to revert to a few git commits ago and see
>> >>> if that does anything for me.
>> >>>
>> >>>
>> >>> Best regards,
>> >>> John
>> >>>
>> >>>
>> >> Hi,
>> >>
>> >> just jumping on the bandwagon.
>> >> My one and only "biggest" issue with wonderful Orgmode is slow Emacs.
>> >> I run Emacs on i7 hardware with lots of memory and still have an Emacs 
>> >> Orgmode that answers rather slowly.
>> >> Slow meaning it is just not snappy at all. Creating any aganda takes 
>> >> several seconds which is a long time to wait
>> >> for the result. I already spent a lot of thought into how to optimise the 
>> >> performance of my system, archiving and
>> >> splitting Org files, using sticky agenda etc.
>> >> I know there is no quick solution to the slowness because of the 
>> >> limitation of threading in Emacs - I just wanted
>> >> to mention that very "unmodern" behaviour of Emacs running Orgmode. I 
>> >> have to use Windows 7 so this makes it even
>> >> slower. I assume my environment would run faster on Linux.
>> >>
>> >
>> > I'm running Arch Linux 64bit on an HP EliteBook 8540w with an i7 and
>> > 8G of RAM. HD is 54% full at present. I agree that this shouldn't be a
>> > big burden, and whatever happened recently really made this unusable
>> > for me. Oddly, generating an agenda only takes a couple of seconds,
>> > which is plenty fast for me, even using search.
>> >
>> >> So yes, this is nothing more than something like a rant.
>> >> For me Orgmode is still the killer app in Emacs, it is just sad to have a 
>> >> slow environment on quite modern
>> >> hardware with some bigger Org files.
>> >> My files are of size:
>> >>
>> >> $ wc *org
>> >>     124    1690   31670 file1.org
>> >>    1555   11829   97805 file2.org
>> >>   35022  262820 2314234 file3.org
>> >>     999    4968  105854 file4.org
>> >>     557    4029   30586 file5.org
>> >>    2523   20324  162165 file6.org
>> >>    2447   19974  139768 file7.org
>> >>     689    4703   36495 file8.org
>> >>    6789   58782  461211 file9.org
>> >>   53078  403126 3531142 total
>> >>
>> >
>> > $ wc *.org
>> >     23     90    867 bibliography.org
>> >     42    192   1756 clocking.org
>> >   2137  18286 122303 devel.org
>> >   9837  74994 494234 projects.org
>> >   1536   9692  77261 reference.org
>> >   1057   6673  48309 tf.org
>> >  14632 109927 744730 total
>> >
>> > projects.org is my most used file by far, and the biggest, but nothing
>> > compared to some of the folks posting on the link I showed who have
>> > 30-130k line files!
>> >
>> >
>> > John
>> >
>> >> Rainer
>> >>
>>
>
>
> ------------------------------------------------------------------
> Russell Adams                            address@hidden
>
> PGP Key ID:     0x1160DCB3           http://www.adamsinfoserv.com/
>
> Fingerprint:    1723 D8CA 4280 1EC9 557F  66E8 1154 E018 1160 DCB3
>