Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > IBM DB2 > Re: Any suggest...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 3 of 4 Topic 9084 of 9520
Post > Topic >>

Re: Any suggestion on how to speed up large batch inserts?

by Arun Srinivasan <arunrocks@[EMAIL PROTECTED] > Jul 14, 2008 at 11:15 AM

On Jul 14, 11:42=A0am, "Mark A" <nob...@[EMAIL PROTECTED]
> wrote:
> "Amber" <guxiaobo1...@[EMAIL PROTECTED]
> wrote in message
>
>
news:89c3ccaa-ddf4-4688-96b5-8e18cee535d3@[EMAIL PROTECTED]
>
>
>
>
>
> > We are using 8.2.9 Windows 64 edtion, in one of our projects we need
> > to recreate a few lager tables which have =A0many millions of rows
each=
,
> > we have used concurrent Java threads to read from data source and do
> > batch inserts to the target tables concurrently, to speed up the
> > inserts we have used the following configuration policies:
>
> > 1. Use large page size (32K) and extend size (256) on the target db,
> > 2. Use large buffer pools for the tablespaces which contains the large
> > tables on the target db.
> > 3. Set num_cleaners to 4 to speed up moving data from bufferpool to
> > disks on the target db, we have 4 =A04-core CPU on the server.
> > 4. Set chngpgs_thresh to 80%, using this value we mean avoiding DB2 to
> > moving data from bufferpool to disk too frequtenlly, because when
> > doing these inserts we have not other readers on the target.
> > 5. Use lage page size(32K) and extend size(256) and prefetch size
> > (256) on the source db.
> > 6. Use lage bufferpool on the source db.
> > 7. Set num_ioservers to 4, we have 4 4-core cpu on the source db.
>
> > We are not sure about the chngpgs_thresh value, any suggestions?
>
> Instead of modifying the chngpgs_thresh, set the
> DB2_USE_ALTERNATE_PAGE_CLEANING to ON (with db2set).
>
> In the db cfg, set you logbuffsz to about 256. This requires that you
> increase DBHEAP by same amount since it is part of DBHEAP memory.- Hide
q=
uoted text -
>
> - Show quoted text -

This has become a performance tuning thread, but I'd use a cursor load
instead, great speed, no space usage..
 




 4 Posts in Topic:
Any suggestion on how to speed up large batch inserts?
Amber <guxiaobo1982@[E  2008-07-14 02:10:03 
Re: Any suggestion on how to speed up large batch inserts?
"Mark A" <no  2008-07-14 12:42:35 
Re: Any suggestion on how to speed up large batch inserts?
Arun Srinivasan <arunr  2008-07-14 11:15:51 
Re: Any suggestion on how to speed up large batch inserts?
Norm <w_norman@[EMAIL   2008-07-29 09:03:49 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Tue Dec 2 20:35:39 CST 2008.