Because of the high volume of data inserts into the target table these indexes got fragmented heavily up to 85%-90%. During analysis we found that the target table had a primary clustered key and two non-clustered keys. Initially when the SSIS package started, everything looked fine, data was being transferred as expected but gradually the performance degraded and the data transfer rate went down dramatically. Recently we had to pull data from a source table which had 300 millions records to a new target table. Because of this, along with hardcore BI developers, database developers and database administrators are also using it to transfer and transform data.īest Practice #1 - Pulling High Volumes of Data
It comes free with the SQL Server installation and you don't need a separate license for it. The best part of SSIS is that it is a component of SQL server. SSIS 2008 has further enhanced the internal dataflow pipeline engine to provide even better performance, you might have heard the news that SSIS 2008 has set an ETL World record of uploading 1TB of data in less than half an hour.
What I mean is, SSIS is not an enhancement to DTS but rather a new product which has been written from scratch to provide high performance and parallelism and as a result of this it overcomes several limitations of DTS. If you are coming from a DTS background, SSIS packages may look similar to DTS packages, but it's not the case in reality. As mentioned above, SSIS is the successor of DTS (of SQL Server 7/2000).
0 kommentar(er)
