Once you can test the performance of your program under actual operating conditions, then it's OK to start tweaking, because you'll know if your tweaks are helping or not. But assuming, "Oh, gee, I think if I change this, it will go faster," is usually counterproductive in Java ...