Home / Blogs

Similarity of gTLD Applications: Required Reading for Evaluators

ICANN’s evaluators should look at data published on this site. This sort of data helps dramatically reduce time and expense for the evaluation of new gTLD applications while increasing quality. The principle is simple: find the similarities between the 1930 applications.

It is a proof-of-concept project by Arnoldo Mueller-Molina, a young Costa Rican researcher with a doctorate in computational analytics. The analysis is work in progress, but what it shows is striking: identical answers are ubiquitous, even for the most TLD-specific questions.

For many of the key questions, the number of unique answers is below 600 (compared to 1930 applications). Some of the nominal number of unique answers are higher, but mind you, this is just the first iteration. As the algorithm gets refined and adapted, more patterns are found.

Similarity comparisons make sense between questions 15 and 50. For question 14a-14e, similarity comparisons make sense in some cases. ICANN does not publish the technical plan (Q30b-44) and the financial plan (Q45-50b). The site therefore compares the responses 14a-30a (a total of 26 response fields).

If ICANN ran the similarity engine on questions 30b-50b (another 26 response fields, 15 for the technical plan and 11 for the financial plan), it is certain to find an over overwhelming degree of similarity. It would be appropriate for ICANN to publish anonymized statistics as to how many response fields contain exactly the same content after allowing of variations of TLD string and applicant name.

This is all thanks to the Costa Rica ICANN meeting in March this year. Arnoldo was there with a “Newcomer” badge, having come home with PH.D., after spending several years in Japan and Germany. I regard it as proof that the ICANN community is a magnet for talent beyond politics and domain investors.

Arnoldo talked to a number of ICANN delegates and learned about the new gTLD program. He specializes in computational analytics, not domain names. His area of specialization is the art of detecting patterns of similarity. That is a good fit for the new gTLD program. With 1930 applications, it is too time-consuming to find similarities by hand. Arnoldo parsed all the 1930 applications and compared them side by side, using the Okapi BM25 algorithm for a start.

For each question or sub-question, Arnoldo’ engine identifies groups (or Clusters) of similar answers. For each group, the algorithm identifies the “model of the group”—it would be defined as the one in the group that appears to be “more similar than others” within the group. That sounds like the Orwellian “more equal than others” but does actually make sense. Arnoldo’s site offers side-by-side comparison of each element in a group to the model of the group.

Arnoldo is using his own time and resources to provide this service to the community. A lot more could be done with funding. ICANN could save millions of dollars for itself and others by spending a modest amount for services from experts like Arnoldo. Get some cultural help too: Arnoldo speaks Spanish, English and Japanese, he is perfectly at ease with CJK domains.

(Disclaimer: I have no relationship with Arnoldo or simMachines, his start-up company. I am just impressed by his work and I know for a fact that it is sorely needed. My only involvement is having responded to Arnoldo’s questions, as did others who met him in San José.)

Filed Under

Comments

Comment Title:

  Notify me of follow-up comments

We encourage you to post comments and engage in discussions that advance this post through relevant opinion, anecdotes, links and data. If you see a comment that you believe is irrelevant or inappropriate, you can report it using the link at the end of each comment. Views expressed in the comments do not represent those of CircleID. For more information on our comment policy, see Codes of Conduct.

CircleID Newsletter The Weekly Wrap

More and more professionals are choosing to publish critical posts on CircleID from all corners of the Internet industry. If you find it hard to keep up daily, consider subscribing to our weekly digest. We will provide you a convenient summary report once a week sent directly to your inbox. It's a quick and easy read.

I make a point of reading CircleID. There is no getting around the utility of knowing what thoughtful people are thinking and saying about our industry.

VINTON CERF
Co-designer of the TCP/IP Protocols & the Architecture of the Internet

Related

Topics

New TLDs

Sponsored byRadix

Domain Names

Sponsored byVerisign

Brand Protection

Sponsored byCSC

Threat Intelligence

Sponsored byWhoisXML API

Cybersecurity

Sponsored byVerisign

IPv4 Markets

Sponsored byIPv4.Global

DNS

Sponsored byDNIB.com