Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
Discussion Groups
DB Engine
SQL ServerMSDESQL Server CE
Services
Analysis (Data Mining)Analysis (OLAP)DTSIntegration ServicesNotification ServicesReporting Services
Programming
CLRConnectivitySQLXML
Other Technologies
ClusteringEnglish QueryFull-Text SearchReplicationService Broker
General
Data WarehousingPerformanceSecuritySetupSQL Server ToolsOther SQL Server Topics
DirectoryUser Groups
Related Topics
MS AccessOther DB ProductsMS Server Products.NET DevelopmentVB DevelopmentJava DevelopmentMore Topics ...

SQL Server Forum / Other Technologies / Clustering / July 2008

Tip: Looking for answers? Try searching our database.

performance in a large table

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
Richard Douglass - 19 May 2008 18:20 GMT
We are having problems with database performance at some of our bigger
customers.  Our biggest customer has a 1.1 TB database and they are not
happy.

We have done a number of tests on the system and every indication is that we
have a disk problem.  The CPU never exceeds 25% utilization but the drives
are high 90% all the time.  Our current model is a standard install on a big
SAN disk.

A solution is being presented that would take our most active table and
split it up into smaller units on separate servers.  We would then have a
master table in the production database that would tell the application
where the records for a customer had been re-routed.  (Customer X has his
records in server ABC, database 123, Table XYZ ...  Customer Y has his on
server QQQ database 555 Table PQR)

What are your thoughts and do you have a better idea?

Thanks!
Richard
Andrew J. Kelly - 20 May 2008 00:57 GMT
Well I certainly wouldn't go making a bunch of changes unless you know
exactly what the issue is. Determining if the SAN is the bottleneck and the
true source of the problem is not that difficult these days. And if you can
determine that it is you need to also determine why it is. Is it due to the
fact you are reading or writing too much data or is it simply misconfigured
for the load?  I have seen many systems try to upgrade their storage only to
find out that some tuning and optimization in the code or schema saves a ton
of I/O and costs a lot less money. Is the SAN configuration not appropriate
for the load?  Most SAN's are not properly configured for a high end SQL
Server load but that doesn't mean you can't fix that. Both of these are
certainly easier to fix than splitting the db across several servers.  It
really sounds to me like the database code or schema is simply not optimized
for such a large db and that needs to be addressed first.

Signature

Andrew J. Kelly    SQL MVP
Solid Quality Mentors

> We are having problems with database performance at some of our bigger
> customers.  Our biggest customer has a 1.1 TB database and they are not
[quoted text clipped - 18 lines]
> Thanks!
> Richard
Linchi Shea - 04 Jun 2008 14:16 GMT
> Determining if the SAN is the bottleneck and the
> true source of the problem is not that difficult these days.

That assumes that you are not talking into a void when you are talking to
your storage folks.

Linchi

> Well I certainly wouldn't go making a bunch of changes unless you know
> exactly what the issue is. Determining if the SAN is the bottleneck and the
[quoted text clipped - 32 lines]
> > Thanks!
> > Richard
TheRealRobbie - 02 Jul 2008 15:46 GMT
I agree with Andrew that having you data on A Big SAN Disk is not a guarantee
that performance will be anything near optimal.

I've witnessed cases where moving databases to a single 7200rpm sata disk
actually improved performance (I'm not exagerating here :)

So, if you haven't already, try first to figure out how exactly the SAN is
configured, and if improvements can be made there. I realize this will
probably mean stepping on some toes :)

If nothing can be gained, the data dependant routing solution you proposed
is probably the sanest option, provided you have access to the source code of
the application.

More options are (high level white paper) discussed here:
http://msdn.microsoft.com/en-us/library/aa479364.aspx

Good luck,
Rob

> We are having problems with database performance at some of our bigger
> customers.  Our biggest customer has a 1.1 TB database and they are not
[quoted text clipped - 16 lines]
> Thanks!
> Richard
Alex Wilson - 04 Jul 2008 09:47 GMT
Hi Guys

In our shop we have 2TB of data stored on a SAN, originally it was one
huge volume. That yielded really poor performance.

So we had our SAN guys (after lots of denial from them) partition up
the SAN into 10 different Volumes, we then partitioned our biggest
table ( > 1TB ) across these 10 volumes, and performance was a lot
better. Maybe you should look into (if you haven't already) Table/
Index partitioning, we've had massive improvements by implementing it.

Good Luck,

Alex
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2008 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.