sureshv


I want to transform textfiles to sql server set based and not row based.what would be the best way to transfer.

let me know.




Re: suggestions

Jamie Thomson


I don't understnad the question but have you tried the SSIS data-flow Or BCP perhaps

-Jamie







Re: suggestions

sureshv

yep i did try data flow task.And in dataflow i used conditional split,lookups etc...but do they transform data using set based or row based..how do i transform data set based




Re: suggestions

Jamie Thomson

sureshv wrote:
yep i did try data flow task.And in dataflow i used conditional split,lookups etc...but do they transform data using set based or row based..how do i transform data set based

Maybe its just me being stupid but I still don't understand. What do you mean you want to transform data "set-based" Can you give an example

-Jamie






Re: suggestions

sureshv

Sorry for that...what i mean by set based is i dont want the data to be transfered row by row (one at a time)instead a group of records at one time.

hope you get it





Re: suggestions

Tom Phillips

This is what you are looking for, "parsing non-standard files"

http://msdn2.microsoft.com/en-us/ms345160.aspx




Re: suggestions

sureshv

i couldnt get to the site...And i dont think that inserts batch of records at a time.



Re: suggestions

Jamie Thomson

 sureshv wrote:

Sorry for that...what i mean by set based is i dont want the data to be transfered row by row (one at a time)instead a group of records at one time. 

hope you get it

So you don't want to insert records into the destination one-by-one. is that correct The use the OLE DB Destination with fastload option.

I've talked about this alot here:

Destination Adapter Comparison
(http://blogs.conchango.com/jamiethomson/archive/2006/08/14/4344.aspx)

The steps that you carry out in the data-flow (conditional split etc...) are irrelevant.

-Jamie

 

 






Re: suggestions

sureshv

yes you are write.Thankyou.

for your information the conditional split etc which i am using is to check if the incoming data has any error.

And i have one more question

I want to have some kind of security how is it possible in my package





Re: suggestions

Jamie Thomson

Lots of ways. if I were you I'd be a bit more specific.






Re: suggestions

sureshv

Actually i am new to this topic

Ok i am trying to transfer data from text files to sql server.

in the process in control flow i have execute sql task where i give connection.and then in the dataflow i transfer data

what i feel is giving conection direcly is it safe.

and in my data flow too i dont use any variables like global variable used earlier in sql 2000

Earlier in sql 2000 there were ways like we set a config file,global variable while passing data etc

how can security be implemented any suggestion please let me know.

I appreciate your help