Hi Cato,
Unfortunately, it's both hardware and software that cause the latency. Android developers are working on a software solution that will reduce the latency (they say so), and maybe, regardless the hardware, the latency will vanish on your device. Until then, we pretty much did all we could do to get rid of the latency. Sad but true. Cheers!