URL Classification
using Bag of Features (BoF)
of URL bitstream
Keiichi Shima & Hiroshi Abe (IIJ Innovation Institute, Inc.)
Daisuke Miyamoto (Nara Institute of Science and Technology)
Tomohiro Ishihara, Kazuya Okada & Yuji Sekiya (The University of Tokyo)
Yusuke Doi & Hirochika Asai (Preferred Networks, inc.)
3- 01

02

03

04

05

06

07

08

09

10

11

12

13

14

15

東大マーク 基本型〈タテ〉
CAIDA-WIDE
Workshop on 2017-11-20 @ Keio University
東大マーク集基本型〈タテ〉

2

最小サイズ

PROJECT

15mm

1

Outstanding AI works• In recent years, AI, more specifically, Deep Learning (DL),is getting notable attention• Especially in media recognition fields, such as image,voice recognition, etc.

• Some researchers are also trying to apply DL in diﬀerent
fields (e.g. factory robots, games, etc)

• Back to our works, are we getting a benefit from AI
technologies?

!2

Difficulties• DL (or Machine Learning (ML) also) requires information to
be converted into vectors• We call it as a feature vector• Designing the model of the feature vector requires deep
knowledge of the target information domains!3Why is DL so hot?
• Because recent DL applications don’t require to extract
features manually• A neural network learns which parts of information areimportant from a lot of examples• For example, we can just throw the binary photo data intoa neural network and that’s it• Well, it is not that simple, anyway :)!4

What we are

We are not good atfeature extraction

We havecomputers

Don’t think
Just try

We’ve established the Muscle Learning (ML) team in WIDE
!5

What we try to achieve• We are thinking if we can apply the similar approach used
for image recognition to network information• Just put (almost) raw data and let the machines extract
features• No need to achieve domain specific deep knowledge
before analyzing!6

Back to URLs
• Phishing is one of the major techniques to steal personal
information• 1,220,523 attacks were reported in 2016 (*1)
• There are several services to defend• URL whitelisting• Contents investigation(*1) Anti Phishing WG report: http://docs.apwg.org/reports/apwg_trends_report_q4_2016.pdf!7URL features?
• Challenges• Is there any hidden features in the URL strings used forphishing sites?

• Is it possible to distinguish “white” URLs and “black”
URLs by just looking at the URL strings?

• We try to vectorize URLs to use as input information of
ML methods without any specific domain knowledge!8We need Vectors

How to vectorize?

To utilize ML/DL techniques, we need to encode target entities into vectors.
OK, then, how can we encode URLs to vectors?

URL2CSV

We invented a stupidly simple method to vectorize a URL as shown below.

www.iij.ad.jp/index.html
Split charactersw w w . i i j . a d . j p / i n d e x . h t m lConvert the URL into HEX values

7777772E69696A2E61642E6A703F696E6465782E68746D6C
Extract 8-bits values by shifting 4 bits in the HEX values

77,77,77,77,77,72,2E,
E6,69,96,69,96,6A,A2,
2E,E6,61,16,64,42,2E,
E6,6A,A7,70

3F,F6,69,96,6E,E6,64,
46,65,57,78,82,2E,E6,
68,87,74,46,6D,D6,6C

Count the number of unique values for the host part and the URL
path part respectively (Bag of features)Classiﬁcation using URL2CSV and SVM!9How to vectorize?
www.iij.ad.jp
16 ! 1
42 ! 1
64 ! 1
6A ! 272 ! 1
96 ! 2
A7 ! 1index.html

2E ! 361 ! 169 ! 270 ! 177 ! 5
A2 ! 1
E6 ! 3

2E ! 157 ! 1
68 ! 1
6D ! 178 ! 187 ! 1
E6 ! 1256 dimensional
sparse vector

46 ! 1
65 ! 1
6C ! 174 ! 182 ! 1
D6 ! 1256 dimensional
sparse vector
512 dimensional
sparse vector!10Neural network topology
A 512 dimensional vector generated from a URL string
Linear mapping to 256 nodes

W: (256, 512), float32

b: (256), float32(100, 512), float32

LinearFunction(100, 256), float32

ReLU(100, 256), float32

Dropout

Linear mapping to 256 nodesb: (256), float32

W: (256, 256), float32(100, 256), float32

LinearFunction(100, 256), float32

ReLU(100, 256), float32

Dropout

Reduction to 2 nodesb: (2), float32(100, 256), float32

W: (2, 256), float32

LinearFunction(100, 2), float32(100), int32

SoftmaxCrossEntropy

float32!11

Loss calculation

Classify using
the neural network• Datasets• 26722 “black” URLs downloaded from www.phishtank.com
which are active phishing site URLs as of 2017-4-24• 175290 “white” URLs captured at a research network• Method• Convert all the URLs into vectors and shuﬄe them
• 10% of them were used for the DNN training and the rest
were used for validation!12

Accuracy and Loss(a) Our method (optimizer = Adam)!13

Related Work
• S. Garera, N. Provos, M. Chew, and A. D. Rubin, “A framework for detection and measurementof phishing attacks,” in Proceedings of the 2007 ACM Workshop on Recurring Malcode, ser.
WORM ’07. New York, NY, USA: ACM, November 2007, pp. 1–8.

• J. Ma, L. K. Saul, S. Savage, and G. M. Voelker, “Beyond blacklists: Learning to detectmalicious web sites from suspicious URLs,” in Proceedings of the 15th ACM SIGKDDInternational Conference on Knowledge Discovery and Data Mining, ser. KDD ’09. New York,NY, USA: ACM, June 2009, pp. 1245–1254.

• P. Prakash, M. Kumar, R. R. Kompella, and M. Gupta, “PhishNet: Predictive blacklisting todetect phishing attacks,” in 2010 Proceedings IEEE INFOCOM, ser. INFOCOM, 2010, pp. 1–5.

• B. Sun, M. Akiyama, T. Yagi, M. Hatada, and T. Mori, “AutoBLG: Automatic URL blacklist

generator using search space expansion and filters,” in 2015 IEEE Symposium on Computers
and Communication, ser. ISCC, July 2015, pp. 625–631.

• J. Saxe and K. Berlin, “eXpose: A character-level convolutional neural network withembeddings for detecting malicious URLs, file paths and registry keys,” CoRR, vol. abs/
1702.08568, February 2017.

!14

The neural network topologyof eXpose(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims

ExpandDims

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

W: (100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

EmbedIDFunction

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND(100, 32, 200), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32

Dropout(100, 256, 203), float32

Sum(100, 256), float32

W: (256, 32, 3), float32

b: (256), float32

ConvolutionND(100, 32), float32(100, 256, 201), float32(100, 256, 202), float32

Dropout

Dropout(100, 256, 202), float32

Sum

Sum

(100, 256), float32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100), int32(100), int32(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32?

(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

LinearFunction(100, 32), float32

EmbedIDFunction

ExpandDims(100, 2), float32(100, 32), float32(100), int32(100, 32, 1), float32

float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

SoftmaxCrossEntropy(100, 32), float32(100), int32

ExpandDims(100, 32, 1), float32

b: (1024), float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

ReLU(100, 32), float32(100), int32

ExpandDims(100, 32, 1), float32(100, 1024), float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

Dropout!15(100), int32

EmbedIDFunction

ExpandDims

LinearFunction(100), int32(100), int32(100, 32, 1), float32(100, 1024), float32

b: (2), float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 1024), float32

W: (2, 1024), float32(100), int32(100, 32, 1), float32

b: (1024), float32(100, 32), float32

EmbedIDFunction

ExpandDims

ReLU

W: (1024, 1024), float32(100), int32(100, 32, 1), float32

Dropout(100, 32), float32

EmbedIDFunction

ExpandDims

LinearFunction(100, 32), float32(100), int32(100, 32, 1), float32(100, 1024), float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 1024), float32(100, 32), float32(100), int32(100, 32, 1), float32

b: (1024), float32(100, 32), float32

EmbedIDFunction

ExpandDims

ReLU(100, 32), float32(100), int32(100, 32, 1), float32

Dropout(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

LinearFunction(100, 1024), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32(100, 1024), float32

W: (1024, 1024), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32(100, 1024), float32(100, 1024), float32(100), int32

EmbedIDFunction

ExpandDims(100, 256), float32

W: (1024, 1024), float32(100), int32

EmbedIDFunction(100, 32, 1), float32

Sum(100, 256), float32(100), int32

ExpandDims(100, 32, 1), float32(100, 256, 204), float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

Concat(100, 1024), float32(100), int32

ExpandDims(100, 32, 1), float32(100, 256, 204), float32(100, 32), float32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

W: (256, 32, 5), float32

ConvolutionND

Dropout(100, 256, 201), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

Concatb: (256), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

The neural network topologyof eXpose
A URL string (200 characters at max)(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims

ExpandDims

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

W: (100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

Concatb: (256), float32

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND(100, 32, 200), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32

Dropout(100, 256, 203), float32

Sum(100, 256), float32

W: (256, 32, 3), float32

b: (256), float32

ConvolutionND(100, 256, 201), float32(100, 256, 202), float32

Dropout

Dropout(100, 256, 204), float32

Dropout(100, 256, 201), float32(100, 256, 202), float32

Sum

Sum

(100, 256), float32

W: (256, 32, 5), float32

ConvolutionND(100, 256, 204), float32

Sum(100, 256), float32(100, 256), float32

Concat(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout

W: (2, 1024), float32

b: (2), float32(100, 1024), float32

LinearFunction(100), int32(100, 2), float32

SoftmaxCrossEntropy

float32

Convert each character
into a 32 dimensional
vector(100), int32(100), int32(100), int32(100), int32(100),

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedID(100, 32), float32

ExpandDims(100, 32, 1), float32!16(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

The neural network topologyof eXpose(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims

ExpandDims

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100), int32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

W: (100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32

Concatb: (256), float32

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND(100, 32, 200), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32

Dropout(100, 256, 203), float32

Sum(100, 256), float32

W: (256, 32, 3), float32

b: (256), float32

ConvolutionND(100, 256, 201), float32(100, 256, 202), float32

Dropout

Dropout(100, 256, 204), float32

Dropout(100, 256, 201), float32(100, 256, 202), float32

Sum

Sum

(100, 256), float32

W: (256, 32, 5), float32

ConvolutionND(100, 256, 204), float32

Sum(100, 256), float32(100, 256), float32

Concat(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

LinearFunctionb: (1024), float32(100), int32(100), int32

W: (100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32(100)

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedID(100, 1024), float32

ReLU(100, 1024), float32

Dropout

W: (2, 1024), float32

b: (2), float32(100, 1024), float32

LinearFunction(100), int32(100, 2), float32

SoftmaxCrossEntropy

float32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction2), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32

dDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

t32

Convolution using 4
diﬀerent sizes to make
256 nodes for each(1024 nodes in total)

Concatb: (256), float32

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND(100, 32, 200), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32

Dropout(100, 256, 203), float32

Sum(100, 256), float32

W: (256, 32, 3), float32

ConvolutionND(100, 256, 201), float32(100, 256, 202), float32

Dropout

Dropout

W: (256, 32, 5), float32

ConvolutionND(100, 256, 204), float32

Dropout(100, 256, 201), float32(100, 256, 202), float32

Sum

Sum

(100, 256), float32

b: (256), float32(100, 256, 204), float32

Sum(100, 256), float32(100, 256), float32

Concat(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32!17

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

loat32(100, 32), float32

ms

ExpandDims(100), int32

W: (100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFuncti

The neural network topologyof eXpose(100, 32, 1), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

Concatb: (256), float32

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND

ExpandDims(100), int32(100), int32

EmbedIDFunction(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims

ExpandDims

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32, 1), float32(100, 32, 200), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction

W: (100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

b: (256), float32

ConvolutionND(100, 256, 201), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

W: (256, 32, 3), float32(100, 32), float32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ConvolutionND(100, 256, 202), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32

W: (256, 32, 5), float32(100, 256, 204), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

Concatb: (256), float32

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND

Dropout(100, 32, 200), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32

Dropout(100, 256, 203), float32

Sum(100, 256), float32

W: (256, 32, 3), float32

b: (256), float32

ConvolutionND(100, 256, 201), float32(100, 256, 202), float32

Dropout

Dropout

Dropout

Dropout(100, 256, 204), float32

Dropout(100, 256, 201), float32(100, 256, 202), float32

Sum

Sum

(100, 256), float32

W: (256, 32, 5), float32

ConvolutionND(100, 256, 204), float32

Dropout

Sum(100, 256), float32(100, 256), float32

Concat(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32(100, 256, 203), float32

Dropout(100, 256, 201), float32(100, 1024), float32

W: (1024, 1024), float32(100, 256, 202), float32

b: (1024), float32

LinearFunction(100, 256, 204), float32(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Sum

Sum

Sum

Dropout

W: (2, 1024), float32

b: (2), float32

LinearFunction(100), int32(100, 1024), float32

Sum(100, 2), float32

SoftmaxCrossEntropy

float32(100, 256), float32(100, 256), float32(100, 256), float32(100, 256), float32

ConcatPerform 1024 to 1024
linear mapping 3 times(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout

W: (2, 1024), float32

b: (2), float32

LinearFunction!18(100), int32(100, 2), float32(100, 1024), float32

b: (1024), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

(100, 1024), float32

The neural network topologyof eXpose
Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32, 1), float32(100, 32, 1), float32

ExpandDims

ExpandDims

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction

ExpandDims(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction

ExpandDims(100, 32, 1), float32

W: (100, 32), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100), int32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100), int32(100, 32), float32(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32

Concatb: (256), float32

W: (256, 32, 4), float32

W: (256, 32, 2), float32

b: (256), float32

ConvolutionND(100, 32, 200), float32

b: (256), float32

ConvolutionND(100, 256, 203), float32

Dropout(100, 256, 203), float32

Sum(100, 256), float32

W: (256, 32, 3), float32

b: (256), float32

ConvolutionND(100, 256, 201), float32(100, 256, 202), float32

Dropout

Dropout(100, 256, 204), float32

ReLU

Dropout(100, 256, 201), float32(100, 256, 202), float32

Sum

Sum

(100, 256), float32

W: (256, 32, 5), float32

ConvolutionND(100, 256, 204), float32

Sum(100, 256), float32(100, 256), float32

Concat(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32

Dropout(100, 1024), float32

W: (1024, 1024), float32

b: (1024), float32

LinearFunction(100, 1024), float32

ReLU(100, 1024), float32(100, 1024), float32

Dropout

W: (2, 1024), float32

b: (2), float32(100, 1024), float32

LinearFunction(100), int32(100, 2), float32

SoftmaxCrossEntropy

float32

Dropout

Finally reduce the node
into 2 nodes

W: (2, 1024), float32

b: (2), float32

LinearFunction(100), int32(100, 2), float32

SoftmaxCrossEntropy

float32

OK, great!19(100, 1024), float32

ExpandDims(100, 32, 1), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32(100, 32), float32(100, 32), float32(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32(100), int32(100), int32

EmbedIDFunction

EmbedIDFunction

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100), int32(100), int32

EmbedIDFunction(100, 32), float32

EmbedIDFunction(100), int32

EmbedIDFunction(100), int32

EmbedIDFunction(100, 32), float32(100), int32

EmbedIDFunction(100, 32), float32(100, 32), float32

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims

ExpandDims(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32, 1), float32(100, 32), float32(100, 32, 1), float32(100), int32

EmbedIDFunction(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32(100, 32), float32

ExpandDims(100, 32, 1), float32

Comparison withthe same dataset(a) Our method (optimizer = Adam)(b) eXpose (optimizer = Adam)!20

Summary• We are trying to utilize Deep Learning technologies for
network information• The goal is to provide better vectorization mechanisms for
network data that don’t require any domain specificknowledge• The proposed URL vectorization works with some limited
sets of data, but can be improved more

• We will explore further!21