IDN query trends seen at JPand Root
Kazunori Fujiwara, JPRS
fujiwara@jprs.co.jp
2016/4/3, IEPG meeting

Is IDN use increasing ?
• It is said that IDN is important for nonEnglish speakers• IDN implementations are deployed– Most of web browsers have implemented– Many TLDs support IDN registrations• We need to know the effect of IDN– As a first step, an evaluation of IDN querytrends is easy and may be useful

Copyright © 2016 Japan Registry Services Co., Ltd.

2

DNS-OARC’s Root Datasets• "A Day in the Life of the Internet" (DITL) is a largescale data collection project undertaken by CAIDA
and DNS-OARC every year since 2006
– https://www.dns-oarc.net/ditl/2011/– 48 hours packet capture at root DNS servers and other
DNS servers– Source IP addresses of i.root-servers.net data areanonymizedYearStart(UTC)EndAnalyzed data from2011

Apr 12 1200

Apr 14 1200

a,c,d,e,f,h,j,k,l,m (10/13)

2012
2013
2014

Apr 17 1200
May 28 1200
Apr 15 1200

Apr 19 1200 a,c,e,f,h,j,k,l,m (9/13)
May 30 1200 a,c,d,e,f,h,j,k,l,m (10/13)
Apr 17 1200 a,c,e,f,h,j,k,m (8/13)

Copyright © 2016 Japan Registry Services Co., Ltd.

3

JP datasets• .JP has 1,417,317 registered domain names on March 1, 2016
• JP DNS servers serve approx. 1.6 billion queries per day• Two datasets– Packet captures of all JP DNS servers, around the same time as DNSOARC’s DITL event (and more) since 2009
– Query logs of 2 (A and G) JP DNS servers, every day, for 13 years
NameOperator

Location

Address (IPv4:7, IPv6:6, total 13)

CaptureA.DNS.JP

JPRS

JP*2

203.119.1.1, 2001:dc4::1

Pcap/Log

B.DNS.JP

JPNIC

JP*1

202.12.30.131, 2001:dc2::1

Pcap

C.DNS.JP JPRSWorldwide

156.154.100.5, 2001:502:ad09::5Pcap

D.DNS.JP IIJ

JP*2, US*2

210.138.175.244, 2001:240::53

Pcap

E.DNS.JPWIDE

JP*1, US*1,
FR*1

192.50.43.53, 2001:200:c000::35

Pcap

F.DNS.JP

NII

JP*1

150.100.6.8, 2001:2f8:0:100::153

Pcap

JP*1

203.119.40.1

Pcap/Log

G.DNS.JP JPRS

Copyright © 2016 Japan Registry Services Co., Ltd.

4

Evaluation indexes• Number of registered IDN domain names(JP)• Query ratio of IDN (JP, Root)• Ratio of IP addresses that sent IDN
queries (JP, Root)

Copyright © 2016 Japan Registry Services Co., Ltd.

5

TotalIDN Registration

2005/3/1

2007/3/1

Number of registered JPdomain
names
1,600,000
1,400,000
1,200,000
1,000,000
800,000
600,000

400,000
200,000

2015/3/1

2014/3/1

2013/3/1

2012/3/1

2011/3/1

2010/3/1

2009/3/1

2008/3/1

2006/3/1

2004/3/1

2003/3/1

2002/3/1

2001/3/1

0

Number of JP domain names are increasing gradually
Copyright © 2016 Japan Registry Services Co., Ltd.

6

Number of IDN registrations in JP
160,000

140,000120,000
100,000
80,00060,00040,00020,0002015/3/1

2014/3/1

2013/3/1

2012/3/1

2011/3/1

2010/3/1

2009/3/1

2008/3/1

2007/3/1

2006/3/1

2005/3/1

2004/3/1

2003/3/1

2002/3/1

2001/3/1

0

Number of IDN registration in JP is not increasing now
Copyright © 2016 Japan Registry Services Co., Ltd.

7

Query ratio of IDN at JP DNS(all, 48h)
0.30%
0.25%

Query ratio of third level or below IDN
Query ratio of non-existing IDN
Query ratio of existing IDN

0.20%

0.15%
0.10%

0.05%
0.00%

Queries that contain xn– label is now about 0.25%IDN queries seems to be increasing a little
Non-existing IDN queries are small at JP
Copyright © 2016 Japan Registry Services Co., Ltd.

8

IP address ratio that sent IDNqueries to JP DNS servers (all, 48h)
4.0%
Existing IDN

Non-existing IDN

Third level or below IDN

Any IDN

3.5%

3.0%
2.5%
2.0%
1.5%
1.0%
0.5%
0.0%

••

Now, 3 % of IP addresses send IDN queries at JP
Ratio of IP addresses that send IDN queries may increasing (It is not clear)
Copyright © 2016 Japan Registry Services Co., Ltd.

94.0%3.5%Long term trends of IDN queries
at part of JP DNS servers (A, G, daily)
Ratio of Ipaddr that send IDN queries within 24 hours
Ratio of IDN queries

3.0%
2.5%
2.0%
1.5%
1.0%
0.5%
0.0%

The graph shows increasing tendency, however, irregular data is larger.
Recently, IDN queries are 0.2% and 2.5% of IP addresses send IDN queries
Copyright © 2016 Japan Registry Services Co., Ltd.

10

Long term trends of IDN queries seen atpart of JP DNS servers (A, G, monthly)
2.5%

Ratio of IPaddr that send IDN related

Ratio of IDN queries

2.0%

1.5%
1.0%
0.5%
0.0%

••

Ratio of IP addresses that sent IDN queries may increasing, 2% (It is not clear)
Ratio of IDN queries may be increasing (very small, 0.2% now)
Copyright © 2016 Japan Registry Services Co., Ltd.

11

Long term trends of IDN ratio, monthly
16%

Ratio of IDN Registration

14%

Ratio of IPaddr that send IDN

12%Ratio of IPaddr that send IDN related

10%

Ratio of IDN queries

8%
6%
4%
2%0%

Ratio of IDN queries may be increasing (very small ratio 0.2%)
Ratio of IP addresses that sent IDN query may be increasing
Copyright © 2016 Japan Registry Services Co., Ltd.

12

Number of IDN queries at Root(48hours)
Existing IDN TLD queries
IDN SLD queries
60,000,000

Nonexisting IDN TLD queries
Third level or below IDN queries

50,000,000
40,000,000
30,000,000
20,000,000
10,000,000
0Number of IDN queries seems to be increasing
Copyright © 2016 Japan Registry Services Co., Ltd.

13

Query ratio of IDN at Root (48h)

0.12%

0.10%

Existing IDN TLD

Non-existing IDN TLD

Second level IDN

Third level or below IDN

0.08%
0.06%
0.04%

0.02%0.00%

Ratio of IDN queries seems to be increasing. Non-existing IDN TLD is high ratio.
Copyright © 2016 Japan Registry Services Co., Ltd.

14

Number of IP addresses thatsent IDN at Root (48h)160,000
140,000

120,000
100,000
80,00060,00040,00020,0000Existing TLD
2006/1/10

Non-existing TLD
2007/1/9

2008/3/18

IDN SLDs
2009/3/30

Third level orbelow
2010/4/13

2011/4/12 2012/4/17 2013/5/28 2014/4/15 2015/4/13
Number of IP addresses that sent IDN seems to be increasing
Copyright © 2016 Japan Registry Services Co., Ltd.

15

Ratio of IP addresses that sentIDNseenatRoot(48h)3.0%2006/1/10 2007/1/9
2008/3/18 2009/3/30 2010/4/13
2011/4/12

2012/4/17

2013/5/28

2014/4/15

2015/4/13

2.5%
2.0%
1.5%

1.0%
0.5%
0.0%
IPaddr ratio of existing
IDN TLDs

IPaddr ratio of nonexisting IDN TLDs

IPaddr ratio of any IDN

Ratio of IP addresses that sent IDN seems to be increasing and now 1.5% or 2.5%
Copyright © 2016 Japan Registry Services Co., Ltd.

16

IDN query ratio from eachcountry seen at Root (48h)0.20% RU
0.18% NL
0.16%
0.14%
0.12%
0.10%
0.08%
0.06%
0.04%
0.02%
0.00%

DEAUCA00ALL

USESFRJPARGBBRINCN

IT

Determined by Maxmind GeoLite2 free country databaseCountries whose number of IP address is larger than 100,000 only.
IDN query ratio from Russian IP addresses may be increasing.
Other countries, IDN query ratio is little

Copyright © 2016 Japan Registry Services Co., Ltd.

17

Query source IP address ratio that sent
IDN queries from each country seen at
18.0%
Root (48h)
16.0%
14.0%
12.0%
10.0%
8.0%
6.0%
4.0%
2.0%
0.0%

RU00ALL

JPUSGBBRCACNESAUINFRITAR
Determined by Maxmind GeoLite2 free country database
Countries whose number of IP addresses is larger than 100,000 only.
IDN use in Russia seems to be high. (I don’t know)
Other countries, IDN usage ratio is small
Copyright © 2016 Japan Registry Services Co., Ltd.

NLDE18

Ratio of IP addresses that sendqueries
to each TLD (2015 data)
80%
ALLRU

70%

60%
50%
40%
30%

20%
10%

Top TLDs arecom, net, (ru),org, arpa, ….

From RussianIP address, No.
35 TLD is IDN.
15.7% ofRussian IPaddresses sendxn--p1ai рф(It is the top
IDN TLD.)

0%From all IPaddresses, No.
211 TLD is IDN.
1.4% of IPaddresses sendxn--p1ai (рф).
39.7% of them
are Russian IPaddresses.

1
11
21
31
41
51
61
71
81
91
101
111
121
131
141
151
161
171
181
191
201

TLD rank
Top 210

15.7% of Russian IP addresses sent
xn--p1ai (.рф, Russian TLD) queries.
Well used new gTLDs are here
Some new gTLDs are used more often than IDN TLDsclub, xyz, link
Copyright © 2016 Japan Registry Services Co., Ltd.

19

Findings• Query ratio of IDN is very low now– 0.2% at JP and 0.1% at Root
• DNSSEC is higher than IDN: 5% is DS at JP– However, the query ratio seems to be increasing• Ratio of IP addresses that sent IDN queries is still low.
– 2.5%~3% at JP and 2% at Root
• DNSSEC is higher than IDN– 8.7% of IP addresses send <dom>.jp DS queries– 5~10% of IP addresses send root DNSKEY queries– However, ratio of IP addresses that send IDN queries seems
to be increasing– 15.7% of Russian address sent Russian IDN TLD queries.
IDN TLD .рф seems to be well used in Russia• An increasing trend is observed about IDN– However, it is uncertain. Needs further analysis• Deployment status: IPv6 >> DNSSEC > new gTLD, IDN ?
Copyright © 2016 Japan Registry Services Co., Ltd.

20

Acknowledgements• DNS-OARC as the data source of RootdatasetCopyright © 2016 Japan Registry Services Co., Ltd.

21