I've had a similar experience with latency vs. throughput while
playing around with LFS:  One can crank up the page trip ludicrously
high and throughput goes way up, but the latency makes it useless for
anything besides a constant stream of writes.

I also have been looking for a tool to measure latency, but I suppose
such measurements are best taken from within the kernel anyway ...

--Blair