GoGreen PC Tune-Up™
Learn More

this is how ssl encrypt our websites
MTNCOMP | List View | Table View | myBlog (1742 Entries)
myBlog Home


Rapid7 Open Data and DNS CNAME growth using MS SQL analysis tools

DNS Free Icons by Icons8 SQL

by Mountain Computers Inc., Publication Date: Thursday, June 3, 2021

View Count: 815, Keywords: Rapid7, Open Data, CNAME, Growth, Hashtags: #Rapid7 #OpenData #CNAME #Growth

It's been nearly 3 years since we started analyzing Internet records en mass using Rapid7 Open Data.
Specifically, of all the digests they contained, there was one digest that we found called the CNAME digest .gz.
Our tools process and grind through the data, and then into a deep dive into the data set and then the results. We post process the data, and then go to the wild to further analyze the data in the gz and collect additional results on major key metrics and find trends and analyze those results for upstream and downstream vendors.
Prior to Rapid7, we had rudimentary tools to do a crude analysis yet it worked; specifically from the San Diego Super Computing organization; we did years of folding research and testing with their data processing goals.
Yet when the minds, researches and analysts of the world came together; Rapid7 was the landing zone.
the latest record version 3 review we had 191,048,123 cname records to process and analyze
now, as of yesterday, in version 4 review we had 208,668,040 cname records to process and analyze
it's amazing the growth of domains, related cnames and more.
** what do we do with that knowledge? we apply the research to our consulting and web development and dns management tools, and overall optimization of web content structures.
more to come...

if you found this article helpful, consider contributing $10, 20 an Andrew Jackson or so..to the author. more authors coming soon
FYI we use paypal or patreon, patreon has 3x the transaction fees, so we don't, not yet.

© 2024 myBlog™ v1.1 All rights reserved. We count views as reads, so let's not over think it.