Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
Discussion Groups
DB Engine
SQL ServerMSDESQL Server CE
Services
Analysis (Data Mining)Analysis (OLAP)DTSIntegration ServicesNotification ServicesReporting Services
Programming
CLRConnectivitySQLXML
Other Technologies
ClusteringEnglish QueryFull-Text SearchReplicationService Broker
General
Data WarehousingPerformanceSecuritySetupSQL Server ToolsOther SQL Server Topics
DirectoryUser Groups
Related Topics
MS AccessOther DB ProductsMS Server Products.NET DevelopmentVB DevelopmentJava DevelopmentMore Topics ...

SQL Server Forum / General / Data Warehousing / October 2004

Tip: Looking for answers? Try searching our database.

Best method to transfer data

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
derek - 18 Oct 2004 17:58 GMT
Hi Group,

I just started at a company and am trying to come up with a solution
to streamline the datawarehouse.

The problem is, we have two databases.  Database1 (548 tables) is
generated from user input and we cannot control the schema.  Database2
(40 tables) is a staging DB that optimally will contain some of the
Creates and Updates from the previous day from within Database1.
Database2 is built from a conglomeration of tables in Database1,
therefore we have created 40 views which encapsulates data from
multiple tables in Database1 and are using DTS to call these views and
populate Database2 with a snapshot.

There are 2 problems with the above setup.  First is, we do not need
to take an entire snapshot of the views to populate Database2, we only
need the previous days changes (the DB is growing and we cannot afford
it).  Second, DTS is a pain because we are using a separate view for
every table and a separate DTS package to copy every view to
Database2.  Maintenance is tough.

Currently, we are investigating the use of triggers, but I think this
will end up being a maintenance nightmare also.  Is there anyway to
use replication in conjunction with views to copy *only* the previous
days changes to the other Database?  Or does anyone have any other
suggestions to the best way to set this up?  *Any* insight or advice
on a better setup is welcome.

Thanks much,
Derek
Paul Ibison - 18 Oct 2004 19:55 GMT
Derek,
I haven't set this up for a while, but transactional replication of indexed
views would seem to meet your requirements.
HTH,
Paul Ibison (SQL Server MVP)

>> (recommended sql server 2000 replication book:
>> http://www.nwsu.com/0974973602p.html)
derek - 21 Oct 2004 17:30 GMT
Thanks very much Paul.  Because of your suggestion, I am investigating
using this method.

I read that indexed views tax the system it runs on, so I'm looking at
using transactional replication to replicate the data to another box
which maintains the indexed views, then publish that data to the box
that needs it.

Thanks again,
Derek

> Derek,
> I haven't set this up for a while, but transactional replication of indexed
[quoted text clipped - 4 lines]
> >> (recommended sql server 2000 replication book:
> >> http://www.nwsu.com/0974973602p.html)
Richard S. Hale - 24 Oct 2004 08:07 GMT
Derek take a look at Trey Johnsons DTS Best Practices for Business
Intelligence white paper in msdn online it should steer you in the right
direction as far as coming up with a standard data capture methodology

> Hi Group,
>
[quoted text clipped - 26 lines]
> Thanks much,
> Derek
derek - 26 Oct 2004 23:30 GMT
Wow... About 95% of that article is over my head.  I have a lot of
research to do.  I was actually beginning to thing that SQL server was
limited in it's DataWarehousing.  How wrong was I.

Thanks,
Derek

> Derek take a look at Trey Johnsons DTS Best Practices for Business
> Intelligence white paper in msdn online it should steer you in the right
[quoted text clipped - 30 lines]
> > Thanks much,
> > Derek
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2008 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.