Re-architecturing the Internet:

Bridging Computing and Data over Communication Networks
Hirochika Asai <panda@wide.ad.jp>
Preferred Networks, Inc. / WIDE Project
MPLS Japan / 2021111

My Research Background• 6 years in Esaki lab. + 4 years as Project Assist. Prof. at U. Tokyo& 4.5 years at Preferred Networks, Inc.
• Internet architecture• Traffic engineering and analysis• Network algorithms• Poptrie [SIGCOMM’15]; 200+ Mlps longest prefix matching for IPv4 BGP full route• Palmtrie [CoNEXT’20]; Fast ACL lookup (4.76x faster than DPDK-ACL)• Operating systems for network• Multicore scaling in software forwarding engine & Deep pipelining [NetSoft’19]; 23.1
Mpps routing w/ a single core, 0% packet loss for 143 Mpps w/ 12 cores• Network operations• 10+ years in WIDE Project• IETF NOC for 7+ years

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

2

Applications / Services

•
•
•
•
•
•

5GLocal 5G / WiFiInfrastructure

A4E2P[MVR/MR/AR
Internet of Things (IoT)
%!$*#?L". /

610<*. 4%):2!

The Internet•• Global infrastructure• Submarine cables• Stratosphere• Low earth orbit (LEO) satellites• Geostationary orbit satellites• Access network• Fiber to the home (FTTH)• Cellular networks• Wi-Fi••API

N= '$ (#• 0 VM8^ DgaC;TN=1d F?< 95?<Y7• \]X Q,& 1d/(- eO:I6])/3
• 8^Gc !+@S;('5• ,83+!
• /9&-7&
•  "$#%Access Networks

November 1, 2021

Radio Unit••eCPRI/RoE•
Re-architecturing the Internet by Hirochika Asai•Distributed Unit>hXbT`B:IQAM, Coding, …
MBJf:I (MU-MIMO, etc…)
RH3:I (NOMA, etc…)
UWK_Zi (Backscatter, etc…)
4•!

• #39 (2018) → 53 (2023)• $&184 (2018) → 293 (2023)• M2M



 33% (2018) → 50% (2023)

###



+35.9%+59.2%+141% (~61→147)  ↓    "%: Cisco Annual Internet Report (2018–2023) White Paper
https://www.cisco.com/c/en/us/solutions/collateral/executive-perspectives/annual-internet-report/white-paper-c11-741490.html
November 1, 2021

Re-architecturing the Internet by Hirochika Asai

5



• 1000&=$08)• •   #

7/+"E>

.B(</+C4• The Internet → >:,@• World Wide Web → 9A,@
• -?"'(<' → 16,@
25;%DNovember 1, 2021

!3*

Re-architecturing the Internet by Hirochika Asai

6



• 1000&=$08)• "•  #7/+"E>

.B(</+C4• The Internet → >:,@• World Wide Web → 9A,@
• -?"'(<' → 16,@!#

25;%D!3* → 

November 1, 2021

Re-architecturing the Internet by Hirochika Asai7

Data Flow Computing: Architecture for Data Communication and Distributed Computing–2000s2010s

1-to-N Scalability
Anycast (1995)
Content Delivery Network (1998)

2020

Data Flow

BeyondMore Machine-toMachine (M2M)
Communication

Distributed CDN

P2P; Gnutella (2000)
URI/Name-based Communication
Content Centric Network (2006)
Information Centric Network (2012)
Named Data Networking (2014)
Hybrid ICN (hICN) (2018)
Non-address-based routing
Semantic-based Content Delivery

Semantic Web (2001)
Semantic Router (2002)
Pub/Sub Messaging

MQTT (1999)

Progressive Web Apps; Service Worker (2014)

Sensor Networks
Interplanetary Networking

Offloading

Transcoding (1998)
Distributed Computing
November 1, 2021
SETI@home(1999)

Offline Web Application
Service Mesh

Delay Tolerant Network (2003)

Istio (2017)

To Data Flow Computing

Decoupling of Network Functions

Network Function Virtualization (NFV) (2012)
Service Function Chaining (2013)
Network Programmability

ComputingP4 (2014)
In-Network Computing (2017)
Edge Computing (2014)

Re-architecturing the Internet by Hirochika Asai8Data Flow Computing: Architecture for Data Communication and Distributed Computing
To achieve more scalable and efficient for supporting Machine-to-Machine (M2M) communication
Data: Bound to location
Computation: Anywhere

Producer

Consumer

Function
Function

Producer

Function

Consumer
Function

Function

Consumer

Producer
Function

Function

Function

Consumer
Research Challenges:• Architecture• DevOps: Integration of Computing
and Networking

Abstraction of data unit and path control
Abstraction of computing resources and control• APIs (system interfaces)
Programming paradigm• Continuous integration (CI)
Multi-tenancy• Continuous deployment (CD)• Resource sharing (e.g., slicing)• OAM
November•1, 2021
Re-architecturing the Internet by Hirochika AsaiAccounting••••9  Applications• End-to-End• OSI
• IETF RFC 1122/1123

HTML XML Codec• Transparency (to end-user/end-host)• 5-tuple based• Immutable packets (except for fragmentation)• Globally unique DNS resources…

HTTP FTP SMTP …
TCP

UDP

…

IP
Ethernet PPP…

CSMA/CD CSMA/CA …
Fiber Capper Radio …
Hourglass model

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

10
• Beyond End-to-End• Middleboxes• Separation of Control/Data Planes (+Management Plane)• Transparency (to applications)• URL based• Anycast• Non-unique DNS resources with short TTL (CDN etc.)

Web• Heterogeneous link layers• High-capacity optical circuits: 100/400G Ethernet• High-speed wireless: 5G/6G, Wi-Fi6• Non-Terrestrial Networks: Low-Earth Orbit Satellites, HAPS

• Programmability / Declarative Networking• Privacy, Safety and Security• Trust etc.
November 1, 2021

Re-architecturing the Internet by Hirochika Asai

Cloud

Common Interface to Humans
Multimedia Communication
Content Delivery / Collection
Social Networking
Links to Value…

Virtual Machines / Containers
Elastic/On-Demand ResourceProvisioning
API to Infrastructure
Data Storage…

Internet
Network Function Virtualization
Software-Defined Infrastructure
Edge Computing
Mobile Networks
Non-Terrestrial Networks…
11OSI
(ADU)

L7

Application

Application

L6

Presentation

Presentation

L5

SessionSession

L4

Transport

Transport

TCP (segment),
UDP (datagram)

L3

Network

Network

Network

NetworkIP(datagram)

L2

Data-link

Data-link

Data-link

Data-link

Ethernet(frame)

L1

PhysicalPhysicalPhysicalPhysicalEnd node
November 1, 2021

Network node
Network node(router)(router)
Re-architecturing the Internet by Hirochika Asai

End node12

IETF



Conventional layering model in RFC 1122, 1123

Application Layer

Application Layer

Transport Layer

Transport Layer

IP Layer

IP Layer

IP Layer

IP Layer

IP Layer

Link Layer

Link Layer

Link Layer

Link Layer

Link Layer

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

13

Internet Architecture
CloudAccess NetworkInternet

Data Center

Research Challenges:
5G, Local 5G, etc.
MEC Node

Application Layer

Reconsider layering• Network Programming vs. Autonomous Systems• MEC, Local 5G, Slicing, In-network computing, etc…
• Computing and Storage beyond Network Service•

Application Layer

Application Layer

Edge Computing
Transport LayerTransport Layer

Transport Layer

Service Function Chaining
IP Layer

IP Layer

IP Layer

IP Layer

IP Layer

Link Layer

Link Layer

Link Layer

Segment Routing
Link Layer
November 1, 2021

Link Layer

Re-architecturing the Internet by Hirochika Asai

14

Internet Architecture
Research Challenges:• Reconsider layering and infrastructure services•••

IP service over IP (L3 VPN)
• e.g., purchasing multiple underlay networks with different QoS
Local services• Multicast, Authentication …
Infrastructure for service slicing
IP Layer

IP Layer

IP Layer

IP Layer

IP Layer

Link Layer

Link Layer

Link Layer

November 1, 2021

Link Layer

IP Layer

Link Layer

IP Layer

IP Layer

IP Layer

Link Layer

Link Layer

High availability
High cost

Low availability
Low cost

Network 1

Network 2
Re-architecturing the Internet by Hirochika Asai

15

“Scalable” AND “Programmable” Internet• Scalability: 6' (Synchronous)76' (Asynchronous) -8• 5: !$→ 6'-8• 3&+%(.2,• $ !$"$→ 76'-8 (Eventually Consistent)• 3&"#"

.2, • Programmability• 76'0 ó 6'0• 76'0)914Stateless Service etc.
• 6'0!/*#/*AQMIn-network Telemetry
Service / Service Chaining etc.

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

Stateful16

“Scalable” AND “Programmable” Internet• +1%• UR8 over R8• Pros.
• OFJR8G`UR8G`CK+/!".3]N• Cons.
• :DQ?SJ3$)&'9\R8X6T

• R8 over UR8• Pros.
• 9\M4J>IUR83$)&'HR86T*0@

• Cons. / 7N
• :DL^JWE5<AB=)&'2 B=UR8YZa;
-(#, V_ L^JP[  WE5 November 1, 2021

Re-architecturing the Internet by Hirochika Asai

R817

“Scalable” AND “Programmable” Internet• 0/'*2+/'*2• )3VoIP, Carrier Grade NAT, 5G Mobile Core, Data Center Network (SDN),etc…
• !#• .$%2# /'VoIP-(/'CGN

1,%2#&-(/'→ "#  # Service Function Chaining

November 1, 2021

Re-architecturing the Internet by Hirochika Asai 18

X over  over 
• Data Plane• Data Path and Data Flow Sublayers in the Transport Layer <draft-asai-tsvwgtransport-review>• Control Plane• ToDo…

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

19

Separation of Data Path and Data Flow Sublayers in theTransport Layer <draft-asai-tsvwg-transport-review> (may update RFC 1122, 1123)• Review the transport layer functionality for new distributed computing paradigms:• Pub/sub communication, edge computing, in-network computing, etc…

• Proposed sublayers of the transport layer• Data flow layer: Retransmission, flow control, flow prioritization, end-to-end security, inverse
multiplexing (over multiple data paths)• Data path layer: In-band trajectory monitoring, waypoint management, bidirectional connection,quality monitoring, congestion control, data flow multiplexing, duplication

Application Layer

Application Layer

Data Flow Layer

Data Flow Layer

Data Flow Layer
Data Path Layer

Data Path Layer

Data Path Layer

Data Path Layer

Internet Layer

Internet Layer

Internet Layer

Internet Layer

Internet Layer

Link Layer

Link Layer

Link Layer

Link Layer

Link Layer

IP routerEnd-host

End-host

November 1, 2021

Data path router (e.g., NAT/NAPT,
Data flow node (e.g., edge
Re-architecturing the Internet by Hirochika Asai
congestion control acceleration)
computing, in-network computing)20

Smart Network from End-to-End Principle• End-to-End Principle• Dumb network with smart end-hosts• Smarter network → Non-standardized (or ad-hoc sometimes) architecture for intra-domain services• QoS• DiffServ• Segment routing

path-aware but transparent• Middlebox• Firewall• Content caching, Transcoding• TCP acceleratione.g., force rerouting to a waypoint with policy-based routing• New distributed computing paradigm• Pub/sub model for machine-to-machine communication• Edge computing• In-network computing

November 1, 2021Re-architecturing the Internet by Hirochika Asaie.g., overlay networking

21Transport Layer Functionality:
Data Path vs. Data Flow
• Data Path

→ Stateless or
per-path/per-connection states• Data Flow

→ Per-flow states• Trajectory & waypoint handling• Bidirectional connection• Resource monitoring (e.g., congestion)• Congestion control• Data flow multiplexing• Packet duplication for packet loss recovery (like FEC)
• Retransmission for reliable data communication• Flow control (buffer management)• Flow prioritization• End-to-end security• Inverse multiplexing for multipath protocols

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

22

Use Cases• Multipath transport protocols• Congestion control acceleration• In-network computing• Flow arbitration• etc…
Middleboxes = In-Network Functions

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

23

Stateless per-packet in-network function

Routing
Same program

In-network function
ECMP can be leveraged if the in-network
computing routers do not store any states.

November 1, 2021

Re-architecturing the Internet by Hirochika Asai

IP routerEnd-host24

Stateful per-packet in-network function
Flow 1
Flow 2

Policy-based routing,segment routing, etc.
(w/ flow classification)

Different programs

In-network function

Congestion control
A waypoint must be designated and controlled;i.e., stateful for data paths but stateless for data flows
November 1, 2021

Re-architecturing the Internet by Hirochika Asai

IP routerEnd-host25

Stateful per-packet in-network function
Flow 1
Flow 2

Policy-based routing,segment routing, etc.
(w/ flow
Application
Layer classification)

Different programs
Application Layer

Data Flow Layer
Data Path Layer

Data Flow Layer
Data Path Layer

Internet Layer

Internet Layer
Internet Layer
A waypoint mustbe designated andcontrolled.

Link Layer
November 1, 2021

Link Layer

In-network computing router

Data Path Layer

Link Layer

Data Path Layer

Internet Layer

Internet Layer

Internet Layer

Link Layer

Link Layer

Link Layer

Re-architecturing the Internet by Hirochika Asai

IP routerEnd-host26

More complex computing;e.g., per-flow in-network function
Flow 1e.g., aggregate two consecutive packets per flow

Flow 2Compute+Buffer
Policy-based routing,Segment routing, etc.
(w/ flow classification)

Same program
Compute+Buffer

Flow control

In-network function
e.g., aggregate two consecutive packets per flow

A waypoint must be designated and controlled.
In-network function must be aware of flows.
November 1, 2021

Re-architecturing the Internet by Hirochika Asai

IP routerEnd-host27

More complex computing;e.g., per-flow in-network function
Flow 1e.g., aggregate two consecutive packets per flow

Flow 2Compute+Buffer
Policy-based routing,Segment routing, etc.
(w/ flow
Application
Layer classification)

Compute+Buffer
Application Layere.g., aggregate
twopackets per flow
Data Path Layer
Data
PathconsecutiveLayer

Internet Layer

Internet Layer
Internet Layer
A waypoint mustbe designated andcontrolled.

Link Layer
November 1, 2021

Flow Layer
In-networkDatacomputingrouter

Data Flow Layer

Data Flow Layer
Data Path Layer

Same program

Link Layer

Link Layer

Data Path Layer

IP router
IP router

Internet Layer

Internet Layer

Internet Layer

Link Layer

Link Layer

Link Layer

Re-architecturing the Internet by Hirochika Asai

End-host28

X over  over 
• Data Plane• Data Path and Data Flow Sublayers in the Transport Layer <draft-asai-tsvwgtransport-review>• Control Plane• ToDo…
• Potential Technologies• In-network telemetry• BGP FlowSpec• SRv6’ ideas• DNS ( • ALTO
• …
November 1, 2021DNS

Re-architecturing the Internet by Hirochika Asai)29

• Re-Arch: "2(.*• #+$)0DB G@96M@9ZC

• The Internet → PK:S
• World Wide Web → JW:S
• <R,!&(156M5 → AE:S

• Q;TQ;H\• TQ;H\ → =YN4L• Q;H\ → %/'UFV87O

WIDE ProjectIETF 3I>^?X <panda@wide.ad.jp>  ][  
November 1, 2021

Re-architecturing the Internet by Hirochika Asai

30