Rapid7 Open Data and DNS CNAME growth using MS SQL analysis tools
by Mountain Computers Inc., Publication Date: Thursday, June 3, 2021
View Count: 1008, Keywords: Rapid7, Open Data, CNAME, Growth, Hashtags: #Rapid7 #OpenData #CNAME #Growth
It's been nearly 3 years since we started analyzing Internet records en mass using Rapid7 Open Data.
Specifically, of all the digests they contained, there was one digest that we found called the CNAME digest .gz.
Our tools process and grind through the data, and then into a deep dive into the data set and then the results. We post process the data, and then go to the wild to further analyze the data in the gz and collect additional results on major key metrics and find trends and analyze those results for upstream and downstream vendors.
Prior to Rapid7, we had rudimentary tools to do a crude analysis yet it worked; specifically from the San Diego Super Computing organization; we did years of folding research and testing with their data processing goals.
Yet when the minds, researches and analysts of the world came together; Rapid7 was the landing zone.
the latest record version 3 review we had 191,048,123 cname records to process and analyze
now, as of yesterday, in version 4 review we had 208,668,040 cname records to process and analyze
it's amazing the growth of domains, related cnames and more.
** what do we do with that knowledge? we apply the research to our consulting and web development and dns management tools, and overall optimization of web content structures.
more to come...
if you found this article helpful, consider contributing $10, 20 an Andrew Jackson or so..to the author. more authors coming soon
FYI we use paypal or patreon, patreon has 3x the transaction fees, so we don't, not yet.
© 2024 myBlog™ v1.1 All rights reserved. We count views as reads, so let's not over think it.
