Talk About Network

Google





Data Bases > IBM DB2 > Re: Any suggest...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 4 of 4 Topic 9084 of 9564
Post > Topic >>

Re: Any suggestion on how to speed up large batch inserts?

by Norm <w_norman@[EMAIL PROTECTED] > Jul 29, 2008 at 09:03 AM

On Jul 14, 5:10=A0am, Amber <guxiaobo1...@[EMAIL PROTECTED]
> wrote:
> We are using 8.2.9 Windows 64 edtion, in one of our projects we need
> to recreate a few lager tables which have =A0many millions of rows each,
> we have used concurrent Java threads to read from data source and do
> batch inserts to the target tables concurrently, to speed up the
> inserts we have used the following configuration policies:
>
> 1. Use large page size (32K) and extend size (256) on the target db,
> 2. Use large buffer pools for the tablespaces which contains the large
> tables on the target db.
> 3. Set num_cleaners to 4 to speed up moving data from bufferpool to
> disks on the target db, we have 4 =A04-core CPU on the server.
> 4. Set chngpgs_thresh to 80%, using this value we mean avoiding DB2 to
> moving data from bufferpool to disk too frequtenlly, because when
> doing these inserts we have not other readers on the target.
> 5. Use lage page size(32K) and extend size(256) and prefetch size
> (256) on the source db.
> 6. Use lage bufferpool on the source db.
> 7. Set num_ioservers to 4, we have 4 4-core cpu on the source db.
>
> We are not sure about the chngpgs_thresh value, any suggestions?

If you are using SMS tablespace, I highly recommend enabling multipage
file allocation.  Formatting one page at a time is a big performance
hit.  See
http://publib.boulder.ibm.com/infocenter/db2luw/v8/index.jsp?topi=
c=3D/com.ibm.db2.udb.doc/core/r0002054.htm.

HTH,
Norm
 




 4 Posts in Topic:
Any suggestion on how to speed up large batch inserts?
Amber <guxiaobo1982@[E  2008-07-14 02:10:03 
Re: Any suggestion on how to speed up large batch inserts?
"Mark A" <no  2008-07-14 12:42:35 
Re: Any suggestion on how to speed up large batch inserts?
Arun Srinivasan <arunr  2008-07-14 11:15:51 
Re: Any suggestion on how to speed up large batch inserts?
Norm <w_norman@[EMAIL   2008-07-29 09:03:49 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
localhost-V2008-12-19 Wed Jan 7 21:59:17 PST 2009.