Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
Discussion Groups
DB Engine
SQL ServerMSDESQL Server CE
Services
Analysis (Data Mining)Analysis (OLAP)DTSIntegration ServicesNotification ServicesReporting Services
Programming
CLRConnectivitySQLXML
Other Technologies
ClusteringEnglish QueryFull-Text SearchReplicationService Broker
General
Data WarehousingPerformanceSecuritySetupSQL Server ToolsOther SQL Server Topics
DirectoryUser Groups
Related Topics
MS AccessOther DB ProductsMS Server Products.NET DevelopmentVB DevelopmentJava DevelopmentMore Topics ...

SQL Server Forum / Other Technologies / Full-Text Search / September 2007

Tip: Looking for answers? Try searching our database.

Capacity planning and performance tuning - SQL 2005 Full text inde

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
David Reabow - 10 Sep 2007 12:06 GMT
I’ve been searching for information on how Full text indexing uses hardware
resources (Memory, IO, CPU etc) and how I can plan for scaling up data
volumes and search numbers. I have found that there is more information
regarding improving the actual indexing process but this is a minor aspect to
the project as it will be largely read only after the initial populate.

I realise that full text index data volumes are very dependant on the data
content but is there percentage of overhead that's generally accepted as an
average?

Is there a way to get performance statistics that show how particular
indexes are performing and how they are using the available resources?

Are there performance configurations that apply to searching rather than the
population performance (i.e. sacrifice population performance in favour of
increased search performance)?

Has anyone looked into these issues in the SQL 2008 CTPs?
Hilary Cotter - 10 Sep 2007 15:38 GMT
We are indexing over 2 terabytes. We use a quad 64 bit DL 585, with 8 Gigs
or RAM. We have a RAID 10 drive for our full-text indexes and  these consist
of 15000 rpm drives.

I am not aware of any performance counters which give you the information
you are looking for.

We find that with too many active catalogs search performance declines. So
we have 6 catalogs which have active indexing against them, the rest have
change tracking turned off (there are no updates to these catalogs). We
partition into 50 million row tables each with their own catalog, each in
its own database. We found that this offered best performance as opposed to
a single monolithic index, or 100 million row tables.

I take it you have looked at the following white papers?

http://www.microsoft.com/technet/prodtechnol/sql/bestpractice/ftslesld.mspx

http://www.microsoft.com/technet/itshowcase/content/intdocmgmtsql2005.mspx

Signature

RelevantNoise.com - dedicated to mining blogs for business intelligence.

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com

> I've been searching for information on how Full text indexing uses
> hardware
[quoted text clipped - 18 lines]
>
> Has anyone looked into these issues in the SQL 2008 CTPs?
David Reabow - 10 Sep 2007 17:42 GMT
Thanks Hilary,

These articles have very good suggestions. I'll be trying most of them.

> We are indexing over 2 terabytes. We use a quad 64 bit DL 585, with 8 Gigs
> or RAM. We have a RAID 10 drive for our full-text indexes and  these consist
[quoted text clipped - 38 lines]
> >
> > Has anyone looked into these issues in the SQL 2008 CTPs?
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2009 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.