CAIDA Overview
2019
Bradley Huﬀaker, CAIDAIIJJan 2019

Overview•research• publications 25• workshops 3•

infrastructure• measurement infrastructure• services (API/Web)•datasets2

research

Publications 2019http://www.caida.org/publications/papers•

programmable switches (2 papers)•

traﬃc (2 papers)•

structural (6 papers)•

security (5 papers)•

internet outages (2 papers)•

quality of experience (2 papers)•

policy (4 papers)•workshop reports (2 papers)

23 papers / 2 reports3researchWorkshops 2019http://www.caida.org/workshops/•International Workshop on Darkspace and UnSolicited
Traﬃc Analysis (DUST 2nd)
http://www.caida.org/workshops/dust/1909/•

Active Internet Measurements (AIM 11th)
http://www.caida.org/workshops/aims/1904/•Workshop on Internet Economics: Knowledge ofInternet Structure: Measurement, Epistemology, andTechnology (WIE 10: KISMET)
http://www.caida.org/workshops/kismet/1912/4researchMapkit

http://www.caida.org/funding/satc-mapkit/

identify “key terrain” of a country’s cyberspace:••

AS-Level Transit Influence (ATI)••

Autonomous Systems (AS), IXPs, PoPs, colocation etc

fraction of country’s addresses transiting an ASCountry AS Topology Robustness•

degree to which a country’s address spaceis dependent on a small number of ASes

United Arab Emirates

Etisalat(State-Owned)
Venezuela

CANTV(State-Owned)
Kvant Telecom(Russian enterprise ISP)

China Telecom(State-Owned)
USA

AT&T

100
FASR+Orgin per country•

806040?

200

12

3
4
number of ASes

55

infrastructure

Measurement Infrastructure•

Archipelago (ark)••UCSD Internet Telescope (IBR)••

supports ongoing topology measurement as well as customizedexperiments

packet capture to largely unused address space(one-way traﬃc only)

Passive Trace Capture••

captures packets on Tier 1 10GE backbone link
(two-way traﬃc)shared anonymized headers only6

infrastructure

Archipelago

http://www.caida.org/projects/ark•

CAIDA's active measurement infrastructure•

188 monitors
•
•
•

•

76 IPv6-enabled
165 Raspberry PIs, 23 servers
52 countries

current projects••••

team-probing experiment to collect IPv4 and IPv6 topology (172)
MANIC (89)researcher experiments, e.g., spooferYoutube QOE experiments (11)7

infrastructure

Stardust

http://www.caida.org/funding/stardust/•passive traﬃc monitoring of UCSD Network Telescope•

0.2% of the Internet address space (/9+/10)•traﬃc reaching the router is unsolicited (Internetbackground Radiation)•

we collect and analyze this traﬃc
••
•
•
•

malware attempting to propagate
backscatter from spoofed DoS attacks
misconfigurations
network scans
network outages

8

services

CAIDA Services http://www.caida.org/services

Services

VelaPAnDA

Interfaces

Tags

StatusWeb UI / API

ASN names, org., geo, topologyas-rank.caida.org

publicAPI

BGP traces, AS paths, preﬁxes
bgpstream.caida.org

publicWeb UI

outages, darknet
ioda.caida.org

publicWeb UI / APIcongesDon, interdomain links, IP links restricted
manic.caida.org

Web UI / API

IP topology, ping, traceroute, Arkvela.caida.org

restricted

Web UI

security-related Internet Dme series
hicube.caida.org

restricted

Web UI /APIInternet related database / APIdevelopment

9services

CAIDA Services http://www.caida.org/services

Services

Interfaces

Tags

StatusWeb UI / API

publicPAnDA

Web UI /APIASN names, org., geo, topology
as-rank.caida.org
BGP traces, AS paths, preﬁxes
bgpstream.caida.org
outages, darknet
ioda.caida.org
congesDon, interdomain links, IP links
manic.caida.org
IP topology, ping, traceroute, Arkvela.caida.org
security-related Internet Dme series
hicube.caida.org
Internet related database / API

OKN-KISMETWeb UI / APIInternet idenDﬁer systems

development

FANTAILWeb UI / API

IP and AS level trace, topology DB

development

APIWeb UIWeb UI / API

Vela

Web UI / API
Web UI

publicpublicrestricted
restrictedrestricted
development10

servicesv2
http://asrank.caida.org•

GraphQL•

JSON Output•

AS Information, Organization, Relationships, Visualization

http://api.asrank.caida.org/v2/graphql

IIJ

GraphQL

response# request ASN 3356's degree
query={
asn(asn:"3356") {asnDegree {transit}}}data={“asn": {"asnDegree": {"transit": 5255}}11

services
http://bgpstream.caida.org•

framework for live / historical BGP data analysis•

C/C++ library , Python bindings

12

services
http://ioda.caida.org•

system to detect and visualize Internet outages innear realtime•

interfaces••

dashboardalert feed13

services
http://manic.caida.org•

system to infer congestion with a web interface•

API to Time Series Latency Prob (TSLP) data•

JSON output

14

services

PAnDA(under development)•

unified interface to CAIDA datasets

paperssolutions

topics15

services

OKN-KISMET(under development)•

Open Knowledge Network:
Knowledge of Internet Structure:
Epistemology, and Technology

http://www.caida.org/funding/okn-kismet/
phase 1: multi-stakeholder team building eﬀort•

academic, government, industry•

focus on Internet identifier systems•

explore rich relationships among:••••domain names
Autonomous Systems
IP address
name servers

co-locatedtraceroute probes

Atlas

Archipelago

spooferprobesTLDservers

spooferdns.coﬀee

BGP collectors

RIS

traceroutes

spoofer

WHOIS servers
RouteViews

BGP traces

ITDK

AS Rank

TLD collections

WHOIS Dumps
KISMET

geolocation
serverpolicymakersscientists
operators

16

services

FANTAIL(under development)

Facilitating Advances inNetwork Topology Analysis

http://www.caida.org/funding/ccri-fantail/•IP and AS level trace, topology DB•

scalable search on annotated IP traces

17

datasets

CAIDA Datasets

http://www.caida.org/data/*•

Internet Topology Data Kit (ITDK) (restricted)••

Internet eXchange Points (public)••

https://www.caida.org/data/bogons/
Historic and current CYMRU Bogon data

Topology data (IPv4/IPv6) trace data (restricted)••

http://www.caida.org/data/ixps
IX’s geolocations, prefixex, AS members

CYMRU Bogon Historic (public)••

http://www.caida.org/data/internet-topology-data-kit
IP topologies, routers, geolocations

http://www.caida.org/ipv4_routed_24_topology_dataset.xml
IP topologies, IP trace routes

DNS-names (restricted)•

http://www.caida.org/data/active/ipv4_dns_names_datasert.xml
DNS names for IPs in IPv4 routed /24*selected 18

Questions?
•publications
http://www.caida.org/publications/papers•

workshops
http://www.caida.org/workshops/•services
http://www.caida.org/services•datasets
http://www.caida.org/data/overview/

Bradley Huﬀaker
CAIDA/UCSD
bradley@caida.org

19