I have a large dataset (1 table, 300,000 rows) and I am facing problems in sending that to a webservice. The webservice times out or something but anyway I would not want to send all 300,000 at once. So I am intending to split the rows into say 10 equal divisions. But I do not know how to do that, also I do not know how to merge them on the server side for processing. Any help on this will be appreciated, thanks in advance.

Re: .NET Framework Data Access and Storage Splitting a large dataset


Because webservices are not really suppose to save state between subsequent calls, there is no easy way to merge the dataset in memory on the web server.

What you are better doing is to write the parts of the dataset to a database of some sort on the server, flags the small parts dataset with a id linking them together and a part number e.g. 1 of 10, 2 of 10 etc.

Once the server has detected the last part of the dataset has been loaded in to the system, you can then load the whole dataset back into memory on the server and carry on your process.