Page 1 of 1

Feature request- option to increase sample size on bulk data import

Posted: Thu Nov 02, 2017 6:58 pm
by SteveWx
After recently encountering database import errors, would it be possible to have the 'test import' functionality include more than one row of data? Matching the field numbers with the first row of data appeared to work in the test, yet failed significantly when differences in subsequent rows were encountered. Having 10-20 rows of data tested might help illustrate which delimiter might be the better choice for data imports via text files. Or better yet, allow the user to select how many, or which rows they would like returned in the testing process.

Re: Feature request- option to increase sample size on bulk data import

Posted: Thu Nov 02, 2017 7:28 pm
by Jachym
Hi,
I explained in the other thread why I dont think this is a good thing to do. Also, 10-20 lines... what if the error is at line 200. This does not solve the problem. And if I make it check too many lines it will take too long to load and people will not go through it all anyway.

Re: Feature request- option to increase sample size on bulk data import

Posted: Thu Nov 02, 2017 7:48 pm
by SteveWx
Well, it was worth asking. I'll continue to do it the way I resolved my issue today, which was to upload a text file, test, edit the text file to delete the top row, upload the text file again, test again, edit the text file again, deleting rows until the hour changes from 9 to 10, upload the edited text file, test again...

Re: Feature request- option to increase sample size on bulk data import

Posted: Thu Nov 02, 2017 8:01 pm
by Jachym
In WD log files always use tab