APII	  workshop	  2014	  JGN-­‐X	  update	Seiichi	  YAMAMOTO	  NICT	  /	  The	  University	  of	  Tokyo	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

JGN-­‐X	• JGN-­‐X	  is	  a	  testbed	  network	  infrastructure	  for	  new-­‐
generaJon	  network	  technologies	  (NWGN)	  – Established	  in	  1999	  and	  operated	  by	  TAO	  (an	  ancestor	  of	  NICT)	  – JGN	  (1999.4	  –	  2004.3),	  JGN2	  (2004.4	  –	  2008.3),	  JGN2plus	  (2008.4	  –	  2011.3),	  and	  JGN-­‐X	  (2011.4	  –	  2016.3)	  1999.4	  ATM	  1Gbps	

2004.4	  Wide-­‐area	  Ethernet	  10Gbps	

2011.4	  2008.4	  NWGN/FI	  Service	  PlaWorm	  Net.	  Orchestra5on	  Net.	  VirtualizaJon	  StarBED3	  40Gbps	
100Gbps	APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

Grand	  Goal:	  Network	  R&D	  process	  innova5on	  Experiment	  support	  by	  Testbeds	  Research	  Technology	  Development	  Technology	  Deployment	   Network	   Development	  R&D	  cycle	  and	  Verify	  technologies	  and	  OperaJon	  Deployment	  and	  promote	  product	  Product	  Opera5on	  development	  using	  Testbeds	  Development	  Accumulate	  and	  Share	   Research	  knowledge	  on	  Testbed	  Valida5ng	  products/Educa5ng	  engineers	  using	  Testbeds	  Product	  Development	  InnovaJng	  Network	  R&D	  process	  using	  StarBED3	  &	  JGN-­‐X	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

The	  JGN-­‐X	  Technologies	  at	  a	  Glance	
NWGN	  Services	
Cloud	  for	  SB	NWGN	  Technologies	

PIAX	

Paas,	  SaaS	

P2P	

Virtualized	  Storage	

StarBED3	
Large-­‐Scale	  EmulaJon	

VisualizaJon、DPI	

Monitoring	

DisJributed	  IaaS	vNode	

RISE	

DCN	

DPN	

SDN	

BoD	

Virtualized	  IP	  Service	

CCN/ICN	
IOT	

Virtualized	  Routers	Wireless	

VPLS,	  Pseudo	  Wire	  TradiJonal	  L2/L3	

L2VLAN,	  IPv4,	  IPv6	

APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

ID-­‐Loc.	  
Sep.	

Opt.	  TB	DF	OpJcal	JGN-­‐X	  update	• Physical	  reconstrucJon	  – Circuits	  • Installed	  100GbE	  • Added	  redundant	  path	  – Access	  points	  • Moved	  into	  new	  locaJon	  – Devices	  • Installed	  100GbE	  Available	  Router/Switches/
Transponder/Monitoring	  System	  • Added	  “Virtual	  Storage”,	  etc	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014JGN-X Network (as of Oct. 2014)
Realizing multiple New Generation Network (NWGN) planes on virtual
JGN-X networks and their global interconnection with other testbeds.	
DCN	

DCN	

DCN plane	
DCN	
OF	
OF	

OpenFlow plane
RISE	
OF	

Sapporo	

OF	

OF	

OF	

VN	

Virtual Node plane	 VN	VN	VN	MPLS-based testbed network	
Optical TestbedWireless Testbed

Iwate	
Sendai	

VN	 OF	VN	DCN	

Okayama	

OF	

VN	

NICT
Koganei	Osaka	

VN	 DCN	
OF	Tokyo	

Hiroshima	

Fukuoka	
x2	

Nagoya	Kagawa	
Kochi	x2	Ex	OF	

Okinawa	

Koganei- Otemachi
Otemachi～OtemachiIshikawa	

OF	
VN	
DCN	

OF	

Optical Testbed

100G	
10G	 VN	
Virtual Node	
1G	DF	 OF	Openflow	

VN	 OF	

Bandwidth International	
Japan- USA： 10G
Japan - Korea： 10G
Japan – Hong Kong： 10G
Hong Kong - Singapore 2.4G
Singapore - Thailand： 1G	

Wireless Testbed

DCN	
DCN	

Virtual Storage	

USA	 Thailand	 Singapore	 Hong
Kong	
OF	
OF	
OF	

StarBED	

VN	

South
Korea	

JGN-­‐X	  DomesJc	  100GbE	  upgrade	
100G	  Logical	  SW	100G	  SDN	  RouJng	  SW	100G	  HW	  Router	
RISE	  OpenFlow	  SW	10G	  Legacy	  SW	10G	  Logical	  SW	

Mizusawa	

VNODE	GG	 Osaka-­‐U	
DPI	

Virtual	  Storage	  Service	  	x2	Fukuoka	
Hiroshima	

Okayama	

Sendai	
Tohoku-­‐U	 x3	x2	

Kagawa	
Kochi	

WIDE	

NOC	

SINET4	

Kobe	
Keihanna	

Okinawa	
Nago	

1GbE	
10GbE	
100GbE	

Tokyo-­‐KDDI	

NICT-­‐HQ	

Osaka	CKP	KyuTech-­‐U	
Kyusyu-­‐U	

Sapporo	

Iwate	StarBED*3	

Ishikawa	

NOC	

NOC	
Tsukuba	

Yokosuka	Tokyo-­‐NTT	

Nagoya	APAN	

JGN-­‐X	  InternaJonal	  upgrade	
100G	  Logical	  SW	100G	  SDN	  RouJng	  SW	Ishikawa	
100G	  HW	  Router	
VNODE	
RISE	  OpenFlow	  SW	GG	10G	  Legacy	  SW	10G	  Logical	  SW	DPI	Virtual	  Storage	  Service	  	StarBED*3	
Los	  Angeles	  10GbE	  	  by	  TransPAC3	  Seoul	  10GbE	  	  by	  KOREN	  10GbE	  	  Tokyo-­‐KDDI	

10GbE	  	  Bangkok	

Singapore	

Hong	  Kong	

Osaka	

10GbE	
WIDE	

1GbE	

2.4GbE	
2.4GbE	  	  by	  SINET4	  NOC	Tokyo-­‐NTT	

SINET4	

1GbE	
2.4GbE	 Ø KOREA	  link	  moved	  to	  TOKYO-­‐Seoul	  from	  Fukuoka-­‐Busan	  10GbE	 Ø Upgrade	  SG-­‐TH	  link	  from	  622M	  to	  1Gbps	  	  100GbE	

APAN	

Asian	  Links	
CUHK(HKIX)	

CERNET	

HongKong(Mega	  i-­‐Advantage)	

10Gbps	Juniper	  MX80	

Juniper	  MX80	
Bangkok(Bangkok	  Thai	  Tower)	
1Gbps	

TEIN-SG	

KOREN	

JGN-­‐X	

100Gbps	

10Gbps	

10Gbps	

1Gbps	

2.4Gbps	

1Gbps	

100Gbps	

Juniper	  MX480	

KREONET	

Uninet	SingAREN	

WIDE	
100Gbps	

1Gbps	ThaiSARN	

Osaka	

10Gbps	

10Gbps	

CSTNET	

ThaiREN	

Tokyo(NTT	  Otemachi)	

TEIN-HK	

10Gbps	

10Gbps	

JGN-­‐X(AS17943)	  are	  making	  	  own	  bgp	  peers	  to	  NRENs	

Back	  up	  L2	  	  by	  VPLS	

100Gbps	
Juniper	  MX80	

Juniper	  MX80	
Seoul(LG)	
10Gbps	

1Gbps	  For	  ThaiREN	

Juniper	  MX80	
10Gbps	

10Gbps	Juniper	  EX4500	

Singapore(Global	  Switch)	

APAN-­‐JP	
10Gbps	Back	  up	  L2	  by	  VPLS	

1Gbps	

100Gbps	

Juniper	  MX480	
10Gbps	10Gbps	
Back	  up	  L2	  by	  VPLS	

Juniper	  MX240	
TEIN-­‐JP	10Gbps	

10Gbps	
10Gbps	

SINET4	

Tokyo(KDDI	  Otemachi)	

JGN-­‐X	  update	  (cont’)	
• FuncJonal	  reconstrucJon	  – Modular	  Backbone	  Structure	  • Transport/Support	  Layer	  – PreparaJon	  to	  operate	  100GbE	  • 100G	  Monitoring	  – Redundant	  L3	  rouJng	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

Modular	  Backbone	  Structure	• Transport	  /	  Support	  Layer	  – Separate	  “Backbone”	  and	  “Edge”	  technology	  – Modular	  Structure	  • Use	  virtualized	  technology	  (logical	  router	  /	  VPN	  /	  …)	  • Also	  separate	  physical	  device	  • Easy	  to	  adapt/re-­‐conﬁgure/install	  new	  technology/box	  User	Access	  Point	  X	Access	  Point	  Y	Access	  Point	  Z	Support	  Layer	
Transport	  Layer	
Access	  Point	  1	Backbone	  Network	

APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

Modular	  Backbone	  Structure	  (cont’)	
• Support	  Layer	  – Edge	  funcJon	  (i.e.	  customer	  accommodaJon)	  – Keep	  tradiJonal	  VLAN	  interface	  – Provide	  Ethernet/VLAN	  funcJon	  • Tag	  translate	  • Loop	  guard	  /	  BPDU	  ﬁlter	  • Broadcast	  rate	  limit	  (If	  need)	  • Transport	  Layer	  – Backbone	  funcJon	  – MPLS	  based	  VPN	  (VPLS)	  • LDP	  Plane:	  Dynamic	  Path	  Management	  • RSVP	  Plane:	  Customize	  Path/Bandwidth	  – High	  Speed	  Topology	  Change	  Convergence	  • BFD	  (BidirecJonal	  Forwarding	  DetecJon)	  – “MPLS”	  is	  one	  of	  choice,	  We	  can	  change	  NEW	  technology	  easily.	  
APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

100G	  Class	  Transport	  Experiment	• Prof.	  Hiraki	  (U-­‐Tokyo)	  and	  his	  team	  held	  100Gbps	  Transport	  Experiment	  w/	  NICT.	  
• JGN-­‐X	  NOC	  support	  w/	  Network	  Virtual	  Technology,	  such	  as,	  – Separate	  Slice	  (General/Special)	  – Adapt	  Diﬀerent	  Policy	  • Bandwidth	  Limit	  • Available	  Path	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

100G	  Class	  Transport	  Experiment	  (cont’)	

More	  than	  92Gbps	

APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

100G	  Monitoring	• To	  get	  accurate	  data	  (not	  to	  use	  switch	  monitor)	  – Inter	  Frame	  Gap,	  Order	  of	  pkt,	  etc	  • Monitoring	  Unit	  tap	– OpJcal	  tap	  • Already	  Installed	  **	  Every	  **	  	  BB	  Link	  tap	tap	

– OpJcal	  Cross	  Connect	  • Select	  Input/Output	  OpJcal	  Cross	  Connect	– Per	  packet	  ﬁltering	  device	  • Filter	  out/	  ﬁnd	  speciﬁc	  packet	  – 5	  tuple	  or	  speciﬁc	  papern	  • Support	  100G/40G	  – Capture	  device	  • Presta	  (Customized	  Linux	  Box	  w/	  10G	  NIC)	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

Per	  Packet	  Filter	Capture	  Device	Redundant	  Layer3	  rouJng	
• JGN-­‐X(AS17934)	  BGP	  rouJng	  – Geographically	  separated	  upstream	  • 1Gbps	  @	  Tokyo/Nagoya/Osaka	  • VECTANT(AS2519)	  – Internal	  backup	  route	  – Also	  available	  Traﬃc	  Engineering	VECTANT(AS2519)	
Osaka	

Nagoya	

JGN-­‐X(AS17934)	
APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014

Tokyo	

Conclusion	• JGN-­‐X	  overview	  • JGN-­‐X	  update	  – Physical/FuncJonal	  reconstrucJon	  – Available	  100GbE	  Use	  • 100G	  class	  transport	  experiment	  – Successfully	  ﬁnished	  by	  network	  virtualizaJon	  technology	  w/	  JGN-­‐X	  operaJon	  knowledge	  APII Workshop 2014
Asia-Pacific Information Infrastructure Workshop 2014