Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql General > Re: statistics ...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 8 of 8 Topic 15488 of 16554
Post > Topic >>

Re: statistics collector process is thra****ng my cpu

by willtemperley@[EMAIL PROTECTED] ("William Temperley") May 26, 2008 at 09:36 PM

------=_Part_14771_18136269.1211834171490
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

>
> William Temperley wrote:
> > On Fri, May 9, 2008 at 2:55 PM, Magnus Hagander <magnus@[EMAIL PROTECTED]
>
> > wrote:
> >
> > > William Temperley wrote:
> > > > On Thu, May 8, 2008 at 6:14 PM, Magnus Hagander
> > > > <magnus@[EMAIL PROTECTED]
> wrote:
> > > > > William Temperley wrote:
> > > > >> >  >
> > > > >> >  > Any ideas why this might be happening, and how I can stop
> > > > >> >  > it?
> > > > >> >
> > > > >> >  It'd be interesting to know what the stats collector is
> > > > >> > actually doing. Could you, using Process Explorer or a
> > > > >> > debugger, get a stack trace from that process while it's in
> > > > >> > the tra****ng state?
> > > > >> >
> > > > >> >  //Magnus
> > > > >> >
> > > > >>
> > > > >> Certainly, but I'll have to wait 'til it does it again, it
> > > > >> doesn't happen all the time.
> > > > >> What would you like to know from Process Explorer?
> > > > >
> > > > > Get the backtrace from hung process. Find the process in the
> > > > > list, open it. Go to the tab "Threads", find the thread that's
> > > > > using a lot of CPU (or at least has a lot of ocntext switchs),
> > > > > and click the Stack button. That should give you a window with
> > > > > a backtrace.
> > > > >
> > > > > //Magnus
> > > > >
> > > >
> > > > Ok, got the little blighter. Below are 4 stack traces taken at
> > > > random times. Doesn't seem to be doing much I/O (16 reads and 167
> > > > other in 3 hours). The memory usage seems to be static (3.7MB)
> > > > even with high database usage (vacuum, read, update).
> > >
> > > Hmm. They all show the same function, but it's not a function being
> > > used in the stats collector. I think I missed a step in the
> > > instructions - you need to download the symbols for the server (make
> > > sure you get the same version!) and configure process explorer to
> > > use those (IIRC, it can use detached symbols), then do the same
> > > things again. Sorry for missing that in the first instructions!
> > >
> > > //Magus
> > >
> >
> >
> > Hi Magnus,
> >
> > Sorry I didn't reply earlier (away on holiday). I can't seem to get
> > the symbols to work -
> > I can't find any way to attach symbols in process explorer, however
> > windows debugger can. I've done this:
> > 1. Downloaded the symbols (8.3.1!)
> > 2. Set the path for windows debugger to find them
> > 3. Atttached to the process (offending PID found from process
> > explorer)
> >
> > Then I get this message:
> >
> > Microsoft (R) Windows Debugger Version 6.9.0003.113 X86
> > Copyright (c) Microsoft Cor****ation. All rights reserved.
> >
> > *** wait with pending attach
> > Symbol search path is: C:\Temp\pgsymbols
> > Executable search path is:
> > ModLoad: 00400000 007da000   C:\Program
> > Files\PostgreSQL\8.3\bin\postgres.exe
> > ...........Lots more modload lines .....
> > (eb4.3e4): Break instruction exception - code 80000003 (first chance)
> > eax=7ffd4000 ebx=00000001 ecx=00000002 edx=00000003 esi=00000004
> > edi=00000005
> > eip=7c901230 esp=0235ffcc ebp=0235fff4 iopl=0         nv up ei pl zr
> > na pe nc
> > cs=001b  ss=0023  ds=0023  es=0023  fs=0038  gs=0000
> > efl=00000246
> > *** ERROR: Symbol file could not be found.  Defaulted to ex****t
> > symbols for C:\WINDOWS\system32\ntdll.dll -
> > ntdll!DbgBreakPoint:
> > 7c901230 cc              int     3
> >
> > Any ideas?
>
> Actually, that does not mean it's broken. It just says it can't find
> symbols for where it was - but if this was in ntdll, that's fine. If
> you bring up the full stacktrace at this point, does it contain proper
> data?
>
> //Magnus


Mystery solved, it was PCTools antivirus causing the problem.
It seems pctlsp.dll was interfering when the stats collector process -
Prolonged stepping into the hung process showed pctlsp.dll popping its
head
up now and then, and absolutely no postgres code was run at all.  It was
all
happening within ntdll!LdrShutdownThread.

Uninstalling PCTools solved the problem and restored my faith in Postgres!

Will T

------=_Part_14771_18136269.1211834171490
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

<blockquote style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt
0pt 0pt 0.8ex; padding-left: 1ex;" class="gmail_quote"><div
class="Ih2E3d">William Temperley wrote:<br>
&gt; On Fri, May 9, 2008 at 2:55 PM, <span class="nfakPe">Magnus</span>
Hagander &lt;<a href="mailto:magnus@[EMAIL PROTECTED]
"><span
class="nfakPe">magnus</span>@[EMAIL PROTECTED]
>&gt;<br>
&gt; wrote:<br>
&gt;<br>
&gt; &gt; William Temperley wrote:<br>
&gt; &gt; &gt; On Thu, May 8, 2008 at 6:14 PM, <span
class="nfakPe">Magnus</span> Hagander<br>
&gt; &gt; &gt; &lt;<a href="mailto:magnus@[EMAIL PROTECTED]
"><span
class="nfakPe">magnus</span>@[EMAIL PROTECTED]
>&gt; wrote:<br>
&gt; &gt; &gt; &gt; William Temperley wrote:<br>
&gt; &gt; &gt; &gt;&gt; &gt; &nbsp;&gt;<br>
&gt; &gt; &gt; &gt;&gt; &gt; &nbsp;&gt; Any ideas why this might be
happening, and how I can stop<br>
&gt; &gt; &gt; &gt;&gt; &gt; &nbsp;&gt; it?<br>
&gt; &gt; &gt; &gt;&gt; &gt;<br>
&gt; &gt; &gt; &gt;&gt; &gt; &nbsp;It&#39;d be interesting to know what
the stats collector is<br>
&gt; &gt; &gt; &gt;&gt; &gt; actually doing. Could you, using Process
Explorer or a<br>
&gt; &gt; &gt; &gt;&gt; &gt; debugger, get a stack trace from that process
while it&#39;s in<br>
&gt; &gt; &gt; &gt;&gt; &gt; the tra****ng state?<br>
&gt; &gt; &gt; &gt;&gt; &gt;<br>
&gt; &gt; &gt; &gt;&gt; &gt; &nbsp;//<span
class="nfakPe">Magnus</span><br>
&gt; &gt; &gt; &gt;&gt; &gt;<br>
&gt; &gt; &gt; &gt;&gt;<br>
&gt; &gt; &gt; &gt;&gt; Certainly, but I&#39;ll have to wait &#39;til it
does it again, it<br>
&gt; &gt; &gt; &gt;&gt; doesn&#39;t happen all the time.<br>
&gt; &gt; &gt; &gt;&gt; What would you like to know from Process
Explorer?<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; Get the backtrace from hung process. Find the process
in the<br>
&gt; &gt; &gt; &gt; list, open it. Go to the tab &quot;Threads&quot;, find
the thread that&#39;s<br>
&gt; &gt; &gt; &gt; using a lot of CPU (or at least has a lot of ocntext
switchs),<br>
&gt; &gt; &gt; &gt; and click the Stack button. That should give you a
window with<br>
&gt; &gt; &gt; &gt; a backtrace.<br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt; &gt; //<span class="nfakPe">Magnus</span><br>
&gt; &gt; &gt; &gt;<br>
&gt; &gt; &gt;<br>
&gt; &gt; &gt; Ok, got the little blighter. Below are 4 stack traces taken
at<br>
&gt; &gt; &gt; random times. Doesn&#39;t seem to be doing much I/O (16
reads and 167<br>
&gt; &gt; &gt; other in 3 hours). The memory usage seems to be static
(3.7MB)<br>
&gt; &gt; &gt; even with high database usage (vacuum, read, update).<br>
&gt; &gt;<br>
&gt; &gt; Hmm. They all show the same function, but it&#39;s not a
function being<br>
&gt; &gt; used in the stats collector. I think I missed a step in the<br>
&gt; &gt; instructions - you need to download the symbols for the server
(make<br>
&gt; &gt; sure you get the same version!) and configure process explorer
to<br>
&gt; &gt; use those (IIRC, it can use detached symbols), then do the
same<br>
&gt; &gt; things again. Sorry for missing that in the first
instructions!<br>
&gt; &gt;<br>
&gt; &gt; //Magus<br>
&gt; &gt;<br>
&gt;<br>
&gt;<br>
&gt; Hi <span class="nfakPe">Magnus</span>,<br>
&gt;<br>
&gt; Sorry I didn&#39;t reply earlier (away on holiday). I can&#39;t seem
to get<br>
&gt; the symbols to work -<br>
&gt; I can&#39;t find any way to attach symbols in process explorer,
however<br>
&gt; windows debugger can. I&#39;ve done this:<br>
&gt; 1. Downloaded the symbols (8.3.1!)<br>
&gt; 2. Set the path for windows debugger to find them<br>
&gt; 3. Atttached to the process (offending PID found from process<br>
&gt; explorer)<br>
&gt;<br>
&gt; Then I get this message:<br>
&gt;<br>
&gt; Microsoft (R) Windows Debugger Version <a href="http://6.9.0003.113/"
target="_blank">6.9.0003.113</a> X86<br>
&gt; Copyright (c) Microsoft Cor****ation. All rights reserved.<br>
&gt;<br>
&gt; *** wait with pending attach<br>
&gt; Symbol search path is: C:\Temp\pgsymbols<br>
&gt; Executable search path is:<br>
&gt; ModLoad: 00400000 007da000 &nbsp; C:\Program<br>
&gt; Files\PostgreSQL\8.3\bin\postgres.exe<br>
&gt; ...........Lots more modload lines .....<br>
&gt; (eb4.3e4): Break instruction exception - code 80000003 (first
chance)<br>
&gt; eax=7ffd4000 ebx=00000001 ecx=00000002 edx=00000003 esi=00000004<br>
&gt; edi=00000005<br>
&gt; eip=7c901230 esp=0235ffcc ebp=0235fff4 iopl=0 &nbsp; &nbsp; &nbsp;
&nbsp; nv up ei pl zr<br>
&gt; na pe nc<br>
&gt; cs=001b &nbsp;ss=0023 &nbsp;ds=0023 &nbsp;es=0023 &nbsp;fs=0038
&nbsp;gs=0000<br>
&gt; efl=00000246<br>
&gt; *** ERROR: Symbol file could not be found. &nbsp;Defaulted to
ex****t<br>
&gt; symbols for C:\WINDOWS\system32\ntdll.dll -<br>
&gt; ntdll!DbgBreakPoint:<br>
&gt; 7c901230 cc &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;int
&nbsp; &nbsp; 3<br>
&gt;<br>
&gt; Any ideas?<br>
<br>
</div>Actually, that does not mean it&#39;s broken. It just says it
can&#39;t find<br>
symbols for where it was - but if this was in ntdll, that&#39;s fine.
If<br>
you bring up the full stacktrace at this point, does it contain proper<br>
data?<br><br><font color="#888888">
//<span class="nfakPe">Magnus</span></font></blockquote>
<br>Mystery solved, it was PCTools antivirus causing the problem.<br>It
seems pctlsp.dll was interfering when the stats collector process -
<br>Prolonged stepping into the hung process showed pctlsp.dll popping its
head up now and then, and absolutely no postgres code was run at all.&nbsp;
It was all happening within ntdll!LdrShutdownThread.<br>
<br>Uninstalling PCTools solved the problem and restored my faith in
Postgres!<br><br>Will T<br>

------=_Part_14771_18136269.1211834171490--
 




 8 Posts in Topic:
statistics collector process is thrashing my cpu
willtemperley@[EMAIL PROT  2008-05-08 10:29:05 
Re: statistics collector process is thrashing my cpu
magnus@[EMAIL PROTECTED]   2008-05-08 11:37:01 
Re: statistics collector process is thrashing my cpu
willtemperley@[EMAIL PROT  2008-05-08 11:20:14 
Re: statistics collector process is thrashing my cpu
magnus@[EMAIL PROTECTED]   2008-05-08 19:14:34 
Re: statistics collector process is thrashing my cpu
willtemperley@[EMAIL PROT  2008-05-08 23:55:56 
Re: statistics collector process is thrashing my cpu
magnus@[EMAIL PROTECTED]   2008-05-09 15:55:16 
Re: statistics collector process is thrashing my cpu
magnus@[EMAIL PROTECTED]   2008-05-23 15:33:38 
Re: statistics collector process is thrashing my cpu
willtemperley@[EMAIL PROT  2008-05-26 21:36:11 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Sun Sep 7 1:31:12 CDT 2008.