At the office we had such come on from data collection and a staffer would process them a few at a time. In your case I worry that you are not putting an engineer to the task. That is, you have a custom problem that needs an engineer to go over the problem to see if there's a better design.