SQL 2008 Full text indexing

Thread view:

Enable EMail Alerts

Start New Thread

Thread rating:

David Reabow - 07 Feb 2008 13:37 GMT

Hi all,

Does anyone know if there is a list of improvements to FT indexing in SQL
2008?

So far I've heard that it's integrated into the SQL Server engine and no
longer a seperate process? I'm assuming this has memory implications like
using AWE etc.

I would appreciate any feedback.

Regards
David

Reply to this Message

Jean-Pierre Riehl - 17 Feb 2008 21:35 GMT

Hi,

Yes, that is a major issue to integrate full-text engine into SQL Server.
One of the side effects is performance improvement since full-text querying
is included as operators in Query Execution Plan.

Here are some improvements announced (i'm waiting for next CTP to test it) :
-40 new languages
-Noise words management with T-SQL (CREATE FULLTEXT STOPLITS
-Thesaurus stored in system table and instance-scoped
-indexed keywords querying
-full-text parser querying

Signature

Jean-Pierre Riehl
http://blog.djeepy1.net
http://www.bewise.fr

> Hi all,
>
[quoted text clipped - 9 lines]
> Regards
> David

Reply to this Message

Mike C# - 13 Mar 2008 19:37 GMT

> Hi,
>
[quoted text clipped - 9 lines]
> -indexed keywords querying
> -full-text parser querying

You can create fulltext stoplists in the current CTP. You can also use new
DMV functions to see how your full-text queries are parsed and to view
full-text index keyword entries in the current CTP. The thesaurus is
currently still stored in the file system on this CTP.

Reply to this Message

Simon Sabin - 18 Mar 2008 14:29 GMT

Hello Mike C#,

See my series here http://sqlblogcasts.com/blogs/simons/archive/2008/02/20/SQL-Server-2008---iFTS-N
ew-features-.aspx

Simon Sabin
SQL Server MVP
http://sqlblogcasts.com/blogs/simons

>> Hi,
>>
[quoted text clipped - 14 lines]
> to view full-text index keyword entries in the current CTP. The
> thesaurus is currently still stored in the file system on this CTP.

Reply to this Message

Mike C# - 19 Mar 2008 00:23 GMT

> Hello Mike C#,
>
> See my series here
> http://sqlblogcasts.com/blogs/simons/archive/2008/02/20/SQL-Server-2008---iFTS-N
ew-features-.aspx

Hi Simon, nice blog, but shouldn't you be directing it to Jean-Pierre? :)
Since you're here anyway, any plans to put Thesaurus in the database or will
it remain in the file system in the near future?

Reply to this Message

Mike Hiland - 09 Apr 2008 07:13 GMT

This sounds great. Being able to see the indexed words and the docids they
belong to will help alot with the text mining we are hoping to do. The search
performance gains will be very welcome as well.

I have a few questions:
When you mention that the filestream function means that the blob no longer
needs to be stored in the database, does this also mean that the text output
from the IFilters or stellant can also be stored in the filestream and not in
the database. This would greatly reduce the size of the database.
Also can a fulltext index be used on a column in a partitioned table. If so,
is this a 2005 or 2008 feature. Does anything special need to be done to the
partition function to handle the fulltext index?

> Hello Mike C#,
>
[quoted text clipped - 22 lines]
> > to view full-text index keyword entries in the current CTP. The
> > thesaurus is currently still stored in the file system on this CTP.

Reply to this Message