Slow Issues with load balancing - poor page loading times

[ttrerice80]

I have installed Zentyal 3.5 -

Xeon Quad-Core E Series, 8GB DDR2 RAM, 1TB Western Digital RED Drive, Marvell 1Gb x4 Ethernet


Installed system -
Everything works, but there are times where pages that load in about 2 seconds, take up to 20 seconds to load.
There is 6Mb on DSL on eth0, which is a Dynamic IP, and then 6Mb on eth1, and that has static IP,

Speedtest - checked, and says similar results.

But when we go to the workstation, it can take up to 20 seconds to load a webpage.
Machine
Windows 7, Quad-Core Intel i7770k, 4GB RAM, 240GB SSD, NVidia 640 Series Graphics Card
All 5 machines do the same thing.

If we turn off the load balancing, nd use one line, it seems much faster, but then there is not the failover, and when someone is uploading or downloading files, it slows down quite a lot.

I do not know what to check for, or update.

DNS seems to be resolving properly.
I used NSLOOKUP on the windows 7 pro machine, and it returns the results very quickly.  Usually in less than a second.

Ping Times are 64ms - 75ms to google.com

Any help would be appreciated.