Data processing DNS records off the Internet and ISP network speeds and performance
by Mountain Computers Inc., Publication Date: Monday, June 21, 2021
View Count: 789, Keywords: Data Processing, Internet Records, Internet Speed, Performance, Hashtags: #DataProcessing #InternetRecords #InternetSpeed #Performance
Today was a long day of processing Internet records. The fluctuations in Internet speed can directly affect performance over time. After a while your hard drives and databases catch up rather than being saturated and soon the Internet speed is the bottleneck.
Oh well. 30,000 records per 15 minutes is fast enough on consumer grade connectivity. The crux one also has to watch out for is saturating DNS servers with 30,000 queries per second which is not a factor here. We are doing about 2000 up to 7000 queries per second.
For the price, one get get a bigger pipe, yet a constant pull of 7-10MB/s is good enough especially when the rest of the business traffic is flowing through as well.
We have to balance and tune our records processing tools to mitigate power spikes and DNS saturation.
more to come...
if you found this article helpful, consider contributing $10, 20 an Andrew Jackson or so..to the author. more authors coming soon
FYI we use paypal or patreon, patreon has 3x the transaction fees, so we don't, not yet.
© 2024 myBlog™ v1.1 All rights reserved. We count views as reads, so let's not over think it.
