SSIS Capacity

Pandithurai

Hi ,

We need to upload over 100 GB file into SQL Server using SSIS. I want to know whether SSIS can upload such huge file in to a table. If yes, How . If not is there any work around to achieve this.

Expecting some solutions ASAP

Thanks

Regards

Pandithurai K

Singapore

ggciubuc

If your data have to be transformed, cleaned and this action of uploading is periodically i should use SSIS in any case.

If you have a single file with 100 gb size i shouldn't use SSIS for that.

if you have 100 gb of data in a file that can be bulk inserted in some columns of a table i should use bcp (before change recovery model in "Bulk logged" and after revert to initial recovery model of db) or T-SQL bulk insert command if yor data have not to be cleaned or transformed and in plus there is the effort to build a SSIS package.

Pandithurai

Hi,

Thanks for your response. It is very useful. We cannot use Bulk insert because it involves data cleaning and this need to be done every month. So, We are planning to develope SSIS package to do this. My concern is whether SSIS can handle 100 GB data. or Will it fail due to the file size

Once again Thanks,

Regards

Pandi

ggciubuc

I think it is not a problem .But , what problems would be Workload It is Integration Services Server that ca run a package and cooperate with SQL Engine.In plus this data inserting in many case is made nightly or after 5 pm. Anyway , in your package before and after data flow task change recovery model if you have once to insert 100 gb of data.