I optimised a procedure in a data analysis application I've been creating for work. On a 5GB, 8.9Million record file the analysis process used to take 10hrs 30 mins. After the optimisation it took 1hr 25 minutes. That's over 700% increase in speed with no loss of accuracy. The culprit? Filelocks.