Get ready for a ride and wall of text guys.
Recently we introduced a VPN to replace a 1.5Mbps MPLS line to one of our remote sites. We have a 30/5Mbps cable connection there and a 10/10Mbps bonded T1 at our home site. On the main site we have a Sonicwall NSA 2400 and the remote site is running a Sonicwall TZ 205 with a site-to-site VPN.
When transferring large files over this connection we get fantastic speeds easily maxing out our 10/10Mbps bonded T1 solution. When we start using our database applications though, we start running into problems. We have two primary applications, one a generic application used by our industry and one a custom in house application. The in house application runs amazing, basically running as the same speed as our uses running on our 100Mbps connection, but the generic application runs like awful, worse than even the 1.5Mbps.
I have checked, double checked, and triple checked my firewall, looked at the firewalls packet filters to make sure it is no dropping packets, verified I don't have any routing loops, and yet I am still having massive problems.
After checking all of this and opened wireshark on a remote machine and watched the packets as I opened and used each application. After recording for some time I discovered something interesting. My in house application is sending packets at a rate much high than our generic applications (in the order of a magnitude of speed.).
Here are the graphs of packet rate and bps for each application
Custom Applications
Packet Rate
http:/
Bit Rate
http:/
Generic Application
Packet Rate
http:/
Bit Rate.
http:/
At this point I am pulling my hair out trying to figure this out.