Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Performance > Re: Strange beh...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 11 of 12 Topic 3998 of 4206
Post > Topic >>

Re: Strange behavior: pgbench and new Linux kernels

by matthew@[EMAIL PROTECTED] (Matthew) Apr 18, 2008 at 12:01 PM

On Thu, 17 Apr 2008, I wrote:
>>                                                  There is only one
>>   central tunable (you have to switch on CONFIG_SCHED_DEBUG):
>>
>>         /proc/sys/kernel/sched_granularity_ns
>>
>>   which can be used to tune the scheduler from 'desktop' (low
>>   latencies) to 'server' (good batching) workloads. It defaults to a
>>   setting suitable for desktop workloads. SCHED_BATCH is handled by the
>>   CFS scheduler module too.
>
> So it'd be worth compiling a kernel with CONFIG_SCHED_DEBUG switched on
and 
> try increasing that value, and see if that fixes the problem.
Alternatively, 
> use sched_setscheduler to set SCHED_BATCH, which should increase the 
> timeslice (a Linux-only option).

Looking at the problem a bit closer, it's obvious to me that larger 
timeslices would not have fixed this problem, so ignore my suggestion.

It appears that the problem is caused by inter-process communication 
blocking and causing processes to be put right to the back of the run 
queue, therefore causing a very fine-grained round-robin of the runnable 
processes, which trashes the CPU caches. You may also be seeing processes 
forced to switch between CPUs, which breaks the caches even more. So what 
happens if you run pgbench on a separate machine to the server? Does the 
problem still exist in that case?

Matthew

-- 
X's book explains this very well, but, poor bloke, he did the Cambridge
Maths 
Tripos...                               -- Computer Science Lecturer

-- 
Sent via pgsql-performance mailing list (pgsql-performance@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
 




 12 Posts in Topic:
Strange behavior: pgbench and new Linux kernels
gsmith@[EMAIL PROTECTED]   2008-04-17 03:58:43 
Re: Strange behavior: pgbench and new Linux kernels
matthew@[EMAIL PROTECTED]  2008-04-17 16:52:06 
Re: Strange behavior: pgbench and new Linux kernels
jwbaker@[EMAIL PROTECTED]  2008-04-17 10:09:09 
Re: Strange behavior: pgbench and new Linux kernels
matthew@[EMAIL PROTECTED]  2008-04-17 18:48:25 
Re: Strange behavior: pgbench and new Linux kernels
gsmith@[EMAIL PROTECTED]   2008-04-17 14:15:31 
Re: Strange behavior: pgbench and new Linux kernels
gsmith@[EMAIL PROTECTED]   2008-04-17 20:26:25 
Re: Strange behavior: pgbench and new Linux kernels
david@[EMAIL PROTECTED]   2008-04-17 17:41:39 
Re: Strange behavior: pgbench and new Linux kernels
tgl@[EMAIL PROTECTED] (T  2008-04-18 01:18:54 
Re: Strange behavior: pgbench and new Linux kernels
gsmith@[EMAIL PROTECTED]   2008-04-17 23:25:07 
Re: Strange behavior: pgbench and new Linux kernels
gsmith@[EMAIL PROTECTED]   2008-04-18 02:47:22 
Re: Strange behavior: pgbench and new Linux kernels
matthew@[EMAIL PROTECTED]  2008-04-18 12:01:11 
Re: Strange behavior: pgbench and new Linux kernels
gsmith@[EMAIL PROTECTED]   2008-04-18 13:19:09 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Thu Aug 21 19:24:43 CDT 2008.