Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
Discussion Groups
DB Engine
SQL ServerMSDESQL Server CE
Services
Analysis (Data Mining)Analysis (OLAP)DTSIntegration ServicesNotification ServicesReporting Services
Programming
CLRConnectivitySQLXML
Other Technologies
ClusteringEnglish QueryFull-Text SearchReplicationService Broker
General
Data WarehousingPerformanceSecuritySetupSQL Server ToolsOther SQL Server Topics
DirectoryUser Groups
Related Topics
MS AccessOther DB ProductsMS Server Products.NET DevelopmentVB DevelopmentJava DevelopmentMore Topics ...

SQL Server Forum / Other Technologies / Full-Text Search / March 2007

Tip: Looking for answers? Try searching our database.

Can I delete the gather logs?

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
Optiontrader1138 - 16 Mar 2007 18:26 GMT
The gather logs are huge, full of mostly "success" messages, and are
massively slowing down our FT population time. Can I safely delete
them?
Hilary Cotter - 16 Mar 2007 19:10 GMT
Absolutely, but something is wrong here. I think you are in debug mode.

Have a look at the following key
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer\SQL0000800005
- replacing SQL0000800005 with your actual catalog name.  Make sure the
value of the logsuccesses key is 0.

If it isn't set it to 0 and restart MSSearch.
Signature

Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com

> The gather logs are huge, full of mostly "success" messages, and are
> massively slowing down our FT population time. Can I safely delete
> them?
Optiontrader1138 - 16 Mar 2007 19:25 GMT
It was already zero ...

> Absolutely, but something is wrong here. I think you are in debug mode.
>
[quoted text clipped - 14 lines]
> > massively slowing down our FT population time. Can I safely delete
> > them?
Optiontrader1138 - 16 Mar 2007 19:33 GMT
I stopped the FT service, deleted the main gather log and created an
empty file with the same filename. I then restarted the FT service. It
should've started where it left off, but it doesn't appear that's
happening.

The catalog was initially "idle", which I don't understand. It is set
to "change tracking in background", so I would have assumed it would
start automatically. But it didn't. I kicked off an incremental
population, and it appears that it's started over from the beginning.
In Perf Monitor, the "documents filtered" monitor is currently 0,
while "Waiting documents" is steadily climbing. The new gather file is
already at 627Mb and climbing.

This doesn't seem right. Any ideas?

On Mar 16, 12:25 pm, "Optiontrader1138" <seoconsultan...@gmail.com>
wrote:
> It was already zero ...
>
[quoted text clipped - 20 lines]
> > > massively slowing down our FT population time. Can I safely delete
> > > them?
Hilary Cotter - 16 Mar 2007 19:51 GMT
You should have left it with change tracking. When it is idle it means it
has finished populating/indexing.

You did not need to re-create the gatherer log. I am still a little puzzled
as to why it is giving you all these status messages.

Could you attach the gatherer log here or email it to me offline. Don't post
it as it is hard for me to interpret all the hex.

Signature

Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com

>I stopped the FT service, deleted the main gather log and created an
> empty file with the same filename. I then restarted the FT service. It
[quoted text clipped - 40 lines]
>> > > massively slowing down our FT population time. Can I safely delete
>> > > them?
Optiontrader1138 - 16 Mar 2007 20:03 GMT
As much as I would love to send you the gather log, it is currently
1.17 Gb, so I don't think you'd appreciate me sending it!

"Change tracking in background" is still on. I checked the table and
it definitely was not finished populating when it was idle ... 90% of
the DB was still not indexed and was not showing up in my test
queries.

I think part of the confusion may be that the registry key that you
mentioned may only affect the notifier gather log (in my case, named
SQL0001200005.Ntfy1.gthr). This logfile is only 1k. The 1.17Gb file is
named SQL0001200005.Crwl2.gthr. This is just based on what I've been
able to google so far - let me know if I'm way off-base.

Thanks!!

> You should have left it with change tracking. When it is idle it means it
> has finished populating/indexing.
[quoted text clipped - 56 lines]
> >> > > massively slowing down our FT population time. Can I safely delete
> >> > > them?
Hilary Cotter - 16 Mar 2007 20:18 GMT
Can you export the registry key for this catalog and post it here?

Do other catalog exhibit the same behavior?

Signature

Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com

> As much as I would love to send you the gather log, it is currently
> 1.17 Gb, so I don't think you'd appreciate me sending it!
[quoted text clipped - 78 lines]
>> >> > > massively slowing down our FT population time. Can I safely delete
>> >> > > them?
Optiontrader1138 - 16 Mar 2007 20:33 GMT
Sure - here it is:

Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005]
"LogDirectory"="E:\\SQLData\\SQL0001200005"
"StreamLogsDirectory"="D:\\Program Files\\Microsoft SQL Server\\MSSQL\
\FTData\\SQLServer\\GatherLogs"
"LogName"="E:\\SQLData\\SQL0001200005\\SQL0001200005.Ntfy1.gthr"
"LogNumber"=dword:00000001
"NotificationLogCheckPoint"=hex:80,00,00,00,00,00,00,00
"HistoryHashMapFile"="E:\\SQLData\\SQL0001200005\
\SQL0001200005.Hash.gthr"
"DocIdMapFile"="E:\\SQLData\\SQL0001200005\\SQL0001200005.Idm.gthr"
"NewCrawlNumber"=dword:00000003
"LogSuccess"=dword:00000000
"FollowComplexUrls"=dword:00000000
"DisableRecovery"=dword:00000000
"DisableRobotsExclusion"=dword:00000000
"NormalizeUrls"=dword:00000001
"CaseSensitiveUrls"=dword:00000000
"UseIncrementalCrawlDirIter"=dword:00000000
"ACContentSync"=dword:0000005a
"ACRejects"=dword:00000000
"ACTotal"=dword:00000000
"ACErrorEst"=dword:ffffffff
"ACErrors"=dword:00000000
"ACErrorSamples"=dword:00000000
"ACMaxNoAccess"=dword:00127500
"FilterAlways"=dword:00000000
"LazyCheckPointUpdateInterval"=dword:00015180
"EnableCheckPoint"=dword:00000000
"ACActiveProfile"=hex:ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,
58,81,3c,ed,58,81,\
 3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,
58,81,3c,\
 ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,
58,81,3c,ed,\
 58,81,3c,ed,58,81,3c,33,33,33,3f,
00,00,00,00,00,00,00,00,00,00,00,00,00,00,\
 00,00,00,00,00,00
"ACTrainingProfile"=hex:c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,\

29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,\

34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,\
 c6,89,29,34,c6,89,29,34,8a,e1,ea,
36,00,00,00,00,00,00,00,00,00,00,00,00,00,\
 00,00,00,00,00,00,00
"LogExcluded"=dword:00000000
"LogDisabled"=dword:00000000
"ForceFullCrawl"=dword:00000000
"PausedExternal"=dword:00000000

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Crawls]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Crawls\2]
"CrawlType"=dword:00000002
"InProgress"=dword:00000001
"DoneAddingCrawlSeeds"=dword:00000001
"LogName"="E:\\SQLData\\SQL0001200005\\SQL0001200005.Crwl2.gthr"
"CheckPoint"=hex:80,00,00,00,00,00,00,00

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Extensions]
"IncludedExtensions"=dword:00000001

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Extensions\ExtensionList]
"0"="htm"
"1"="html"
"2"="txt"
"3"="asp"
"4"="xls"
"5"="doc"
"6"="ppt"
"7"="exch"
"8"="xml"
"9"="eml"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Mappings]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\File]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\File\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.FileHandler.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\Http]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\Http\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.HttpHandler.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\MSSQL75]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\MSSQL75\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="sqlfth75.sqlfth75.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\OleDb]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Protocols\OleDb\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.OleDbHandler.1"

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\Sites]

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\StartPages]
"NewStartPageIdentifier"=dword:00000001

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\StartPages\0]
"URL"="MSSQL75://SQLServer/77bfcb91"
"HostDepth"=dword:00000000
"EnumerationDepth"=dword:ffffffff
"FollowDirectories"=dword:00000001
"StartPageIdentifier"=dword:00000000
"CrawlNumberInProgress"=dword:00000002
"CrawlNumberScheduled"=dword:ffffffff
"ForceFullCrawl"=dword:00000000
"LastCrawlStopped"=dword:00000000
"Type"=dword:00000002
"CrawlControl"=dword:00000000
"LastCrawlType"=dword:00000002
"IncludeInProjectCrawls"=dword:00000001
"LastCrawlTime"=hex:86,05,c1,a7,f8,67,c7,01
"NotificationHRes"=dword:00000000

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\Gather\SQLServer
\SQL0001200005\StreamLog]
"CurrentStreamLog"=dword:00000004
"MaxLogs"=dword:00000005
"StreamLogCount"=dword:00000003
Hilary Cotter - 16 Mar 2007 20:38 GMT
It looks good. I am not sure what is going on, other than to say this looks
abnormal.

Signature

Hilary Cotter

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com

> Sure - here it is:
>
[quoted text clipped - 155 lines]
> "MaxLogs"=dword:00000005
> "StreamLogCount"=dword:00000003
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2009 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.