I struggled with latency for many years and followed all the advice given on this forum but eventually realized that the only way to completely eliminate and forget about the problem is to go the hardware route.

For midi I use a midi synth - mine is a Roland SD-50.
For RT's you must use ASIO with an external sound module. I use a Focusrite 2i2 simply as an external sound card so it suites me fine.

Tony