Darshana Bafna

Hello friends!

While working with data generator, I generated about 25000 rows each for about 50 table in a database that are related to each other. And I succeded in that. But when the same process I followed for inserting about 250000 rows, the operation failed giving error for foreign key colums:

"The selected data generator 'Foreign Key' with the selected output 'Output' does not generate data that can be converted to this type" (the type here is the type of the column for which data generation failed)

Since it is a foreign key column, I cannot change the generated column type here. Also, with the same type, the data generator worked fine for lesser number of records. How can I resolve this problem



Re: Visual Studio Team System - Database Professionals Unable to insert large no. of Rows in tables for a Database.

Alle

Hello Darshana,

the ReadMe (2.5.1. Inserting too many rows during Data Generation) indicates that large numbers of rows in data generation can cause exceptions. They are talking about a dependency on the server (SQL Server) hardware and the example was only 1000 rows for 1 GB of RAM.

That would make your 25K for each of 50 tables sound pretty good!

Honestly I have no idea what the maximum is but obviously there is one and I could imagine that 250K rows for each of 50 tables might be a bit much. I believe it is limited by dictionary size in memory

Alle





Re: Visual Studio Team System - Database Professionals Unable to insert large no. of Rows in tables for a Database.

Henry Zhang - MSFT

Does the error occur right after you click Population button or a long time after clicking it

Can you please let me know how the relationships of your 50 tables look like if possible I want to create the similar scenario on my machine and try to repro this problem.

Thanks,






Re: Visual Studio Team System - Database Professionals Unable to insert large no. of Rows in tables for a Database.

Darshana Bafna

The error occurs after a long time after I click the button.

The relationship is quite complex as most of the tables are related to each other, and there are situation where denormalization is carried on to prevent 3-ways join.





Re: Visual Studio Team System - Database Professionals Unable to insert large no. of Rows in tables for a Database.

Henry Zhang - MSFT

Can you share your database backup file with me so that I can repro the problem on my machine In order to do so we need to follow a procedure of my company. I will let you know the details if you want to share the database with me.

Thanks,






Re: Visual Studio Team System - Database Professionals Unable to insert large no. of Rows in tables for a Database.

Darshana Bafna

sorry! but I cannot share the database with you.



Re: Visual Studio Team System - Database Professionals Unable to insert large no. of Rows in tables for a Database.

StevenPo - MSFT

Darshana -

Can you share the definition of the table that is having the issue That may help us identify the cause of your issue.

thanks,