 |
 | Home | Contact Us | FAQ | Search & Site Map | Link to Us |
 | Sign In | Join | Other 45 Sites in Network |
SQL Server Forum / Other Technologies / Full-Text Search / August 2008Full Text search on one column might contain dramatically different languages
Dear All, I have a table for storing text with different language (Chinese / English / Japanese.. etc) like this: ID (int) Lang (char(2)) Story (nvarchar(100)) How can I add full-text-search features on this [Story] for different language? Regards, Ken -- Free News Reader http://put.hk http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html Ken, SQL Server full-text definitions are at the column level, not the row. So, I do not believe that you can do as you ask. If you truly wanted to support all features of the other languages, you would need to have separate language tables or columns. RLF > Dear All, > [quoted text clipped - 15 lines] > http://put.hk > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html Thanks for your quick response. Will change it to varbinary(Max) help? or change to XML type as describe in this article? http://msdn.microsoft.com/en-us/library/ms142507.aspx [quote] For plain text content When your content is plain text, you can convert it to the xml data type and add language tags that indicate the language corresponding to each specific document or document section. For this to work, however, you need to know the language before full-text indexing. [/quote] Regards, Ken -- Free News Reader http://put.hk http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html > Ken, > SQL Server full-text definitions are at the column level, not the row. So, [quoted text clipped - 21 lines] > > http://put.hk > > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html Second question: What if I just want to enable Full Text Search for 1 specify language, say Chinese? Any performance drawback (Both building index and sql enquiry) if there are only 1/4 rows of whole table is Chinese text? -- Free News Reader http://put.hk http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html > Thanks for your quick response. > Will change it to varbinary(Max) help? or change to XML type as describe in this article? [quoted text clipped - 34 lines] > > > http://put.hk > > > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html Word and XML have language aware tags in them. In XML you will have to add them in Word they are automatically there. Then when you index the content will be indexed according to the language tags, no matter what you specified the word breaker language to be for the table. Now when you search you will need to specify the language in your query. The problem is if you search on english words, and specify the chinese languge in your query you will get documents in all languages. If you search on Chinese word and specify the Chinese language in your query you will get documents in all languges which contain those characters you are searching on. However, this will probably work for you. > Second question: > [quoted text clipped - 52 lines] >> > > http://put.hk >> > > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html |
Reply to this Message |
 Sign In
 Join
 My Latest Posts My Monitored Threads My Blog My Photo Gallery My Profile My Homepage Start New Thread Enable EMail Alerts Rate this Thread
|
©2010 Advenet LLC Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.