1

inspect application forum
08.11.2016

Virtual Reality Starts from Reality
THE CHALLENGES AND COMPLEXITIES WHEN DESIGNING
THE CAPTURING SYSTEM

07.12.201
8

Max Larin

2

Virtual Reality Starts with Reality

Virtual Reality Definition

Generate realistic images (and sound)that replicate a real environment
orImmersive, interactive experiencegenerated by a computer

07.12.201
8

Max Larin

3

Virtual Reality Starts with Reality

Where VR is used today?

• Consumer market• Academic researches, education• Art, film production, entertainment• Sports, Media• Industrial installations… and many more
07.12.201
8Max Larin

4

Virtual Reality Starts with Reality

Where VR is used today?

• Consumer market• Academic researches, education• Art, film production, entertainment• Sports, Media• Industrial installations… and many more: NBT – Next BigThing
07.12.201
8Max Larin

5

Virtual Reality Starts with Reality

The Essentials• What is needed?
• Capture the Reality in 3D,• and create/reconstruct it’s model• With high resolution, high frame
rate multiple viewpoints andsynchronous capturing
07.12.201
8Max Larin

6

Virtual Reality Starts with Reality

Ingredients• Suitable sensors• The more pixels the better (HD at least)• At least 30 fps• High dynamic range• Interface to deliver image data to thepoint of use• Processing and storage software• … and much more

07.12.201
8Max Larin

7

Virtual Reality Starts with RealitySensors

High resolution, like:
Mfg.

SensorImage Size [MB]MaxfpsData Rate[MB/s]CMOSIS CMV20000 @12bit 29.5 (5120x3840 @12bit)

32.5

960

CMOSIS CMV12000 @8bit

12.6 (4096x3072 @8bit)

330

4150

CMOSIS CMV12000 @10bit 15.7 (4096x3072 @10bit)

300

4720

CMOSIS CMV50000 @12bit 71.3 (7920x6004 @12bit)

30

2140

07.12.201
8Max Larin

8

Virtual Reality Starts with Reality

Many challenges• Many sensors, many interfaces, manycables• Space• Reliability• Complexity• Bandwidth• Distance• Processor protocol overheads
07.12.201
8

Max Larin

9

Virtual Reality Starts with Reality

Bandwidth challenges

Interface requirements
Mfg.

SensorImage Size [MB]

Max
fps

Data Rate[MB/s]

PCIe
configCMOSIS CMV20000 @12bit 29.5 (5120x3840 @12bit)

32.5

960

x4 Gen2

CMOSIS CMV12000 @8bit

12.6 (4096x3072 @8bit)

330

4150

x8 Gen3

CMOSIS CMV12000 @10bit 15.7 (4096x3072 @10bit)300

4720x8 Gen3

CMOSIS CMV50000 @12bit 71.3 (7920x6004 @12bit)

30

2140x4 Gen3

07.12.201
8

Max Larin

10Virtual Reality Starts with Reality

PCIe solution

Mfg.

SensorImage Size [MB]

Max
fps

Data Rate[MB/s]

PCIeconfig

CMOSIS CMV20000 @12bit 29.5 (5120x3840 @12bit)

32.5

960x4 Gen2

CMOSIS CMV12000 @8bit

12.6 (4096x3072 @8bit)

330

4150

x8 Gen3

CMOSIS CMV12000 @10bit 15.7 (4096x3072 @10bit)

300

4720x8 Gen3

CMOSIS CMV50000 @12bit 71.3 (7920x6004 @12bit)

30

2140x4 Gen3

07.12.201
8Max Larin

11Virtual Reality Starts with Reality

USB3 vs PCIe Integration Solution

07.12.201
8

Max Larin

12

Virtual Reality Starts with Reality

PCIe Integration Solutions• Connections• Arranging• Assembling• Maintaining• TCO

07.12.201
8

Max Larin

13

Virtual Reality Starts with Reality

USB3 vs PCIe Integration Solution

07.12.201
8

Max Larin

14

Virtual Reality Starts with Reality

Integration solutions• Aggregation• Bandwidth• Heterogeneous downstream• Homogeneous upstream• Fiberoptic support• TCO

07.12.201
8

Max Larin

15

Virtual Reality Starts with Reality

PCIe does it all• Space•

Smaller connectors, different orientations•••

Maturity
Low to no latency
Less components••

Standard OTS
TCO: Less components and all standard•••StandardMature
Heterogeneous downstream, homogeneous upstream

•DMA

•

Fiber optic Stds. implemented multifold•

Scalable up to 64Gb/s• Reliability• Cost• Complexity• Processor protocol overheads• Distance• Bandwidth

07.12.201
8

Max Larin

16

Virtual Reality Starts with Reality

PCIe does it all

See it live at XIMEABooth 1C51

07.12.201
8Max Larin

17

Thank you for your attention

07.12.201
8

Max Larin

18