Experiments in 3D Panoramic video

These are interactive 3D panoramic video that requires a video player that understands stereo panoramas like VRPlayer, or Whirligig.
And someway to view in stereo, like using Rift Oculus Rift Virtual Reality headset, Google Cardboard and a smart phone, anaglyph glasses anaglyph glasses, or PC with 3D monitor or TV.

Sample panoramic stereo video from multicamera panoramic stereo video rig using several small inexpensive Mobius cameras.

Download and watch the movie file locally by right clicking the links below and choosing, Save Link As ...

Unless otherwise stated:
- videos are 360° around and 180° vertical, covering the entire sphere.
- 3D videos are in an Over/Under arrangement with one panorama for each eye.


Canada Day Fireworks, Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 1

For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 1

Canada Day Fireworks in 3D

8:40 minutes of video.

Aug 5, 2014
The regular scheduled fireworks for July 1 were canceled because of way too much fog. They were rescheduled to Aug during the Busters on Boardwalk celebrations.

3D 3008 X 3008 pixels, 366 MB
3D 2704 X 2704 pixels, 265 MB
3D 2144 X 2144 pixels, 176 MB
3D 1600 X 1600 pixels, 100 MB
3D 1200 X 1200 pixels, 60 MB

Jan 2015, I processed the raw footage again to create new 3D videos. I created smoother 3D and corrected the sync problems that was at the end. I can not play anything larger than the 2k footage on my PC. The larger versions are there for your testing. If it does not play smooth try a smaller version.

I refocused the soft cameras and added two more cameras to capture the zenith in 2D

The Fireworks are too far away to show any depth. But turning around and looking at the people, depth is very obvious.

For comparison Timelapse shot with Nikon D7000


Bellagio Fountains, Las Vegas, Nevada

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 1

For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 1

Pavilion Cup 4 on 4 Hockey

4:37 minutes of video.

May 28, 2014

3D 4098 X 4098 pixels, 642 MB
3D 2048 X 2048 pixels, 134 MB
3D 1024 X 1024 pixels, 34 MB
Mono 4098 X 2048 pixels, 326 MB
Mono 2048 X 1024 pixels, 70 MB
Mono 1024 X 512 pixels, 20 MB

For comparison I was also recording with my phone panning to capture the action I found most interesting. There is more detail but the camera crops into the action and you are forced to watch where the camera was pointing.

The zenith was crudely patched in post production.

phone 1280 X 720 pixels, 246 MB


4 on 4 Hockey at the Pavilion Cup, Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Dome
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.71875

For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Dome
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.71875

Pavilion Cup 4 on 4 Hockey

8 minutes of video.

Feb 1, 2014

3204 X 2304 pixels, 722 MB, 8 min

The panorama is cropped vertically to 360X130°.

A few of the cameras need to be refocused. Some small sync issues that could be improved.

The Panorama shot while recording.

. Pano


4 on 4 Hockey at the Pavilion Cup, Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 1.0
For Monitor:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 1.0

Pavilion Cup 4 on 4 Hockey

6:43 minutes of video.

Feb 1, 2014

4096 X 2048 pixels, 491 MB, 6:43 min
3008 X 1504 pixels, 223 MB, 6:43 min
2240 X 1120 pixels, 121 MB, 6:43 min
1664 X 832 pixels, 71 MB, 6:43 min

This is a 2D spherical panorama video covering to 360X130° with patches to the zenith and nadir to fill in the complete sphere. Three of the 16 cameras failed so I picked and choose the remaining to get the best to make a 2D video.

The lenses are spread out much farther than I like for capturing 2D. If I was only intending on shooting 2D then I would have the lenses packed much closer together to minimize the parallax issues as much as possible.


rEVOLUTIONary Fire Dancers at the Pavilion Cup, Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Dome
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.71875

For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Dome
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.71875

Pavilion Cup rEVOLUTIONary Fire Dancers

26 minutes of video.

Feb 1, 2014

3204 X 2304 pixels, 1.8 GB, 26 min

The panorama was cropped to 360X130°.

Somehow when I added the audio back I got it slightly out of sync.

A few of the cameras need to be refocused.

 


Fireworks at the Pavilion Cup, Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Dome
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.71967654

For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.72

Pavilion Cup Fireworks

5 minutes of video.

Feb 1, 2014

1920 X 1376 pixels, 294 MB, 5 min

3584 X 2576 pixels, 741 MB, 5 min


The panorama was cropped to 360X130°.

Testing 14 camera rig to capture 360° in stereoscopic 3D.


Sunset, Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Dome
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1
----------> Vertical coverage: 0.5

2013 to 2014 New Years Fireworks

20 minutes of video compressed into a 1 minute timelapse.

Jan 21, 2014

4096 X 2048 pixels, 360 MB, 1 min

The panorama was cropped to 360X90°.

This is my first test of using the full 14 camera rig to capture 360° in stereoscopic 3D. Unfortunately two of the cameras did not record. The faulty cameras were the left and right view of the exact spot where the sun was going down. The -20°C cold weather meant the cameras did not record as long as I hoped. record time were between 20:48 and 53:50, averaging 37:30 minutes.


Sunset, Saint John, New Brunswick VRPLAYER SETTING:

For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

2013 to 2014 New Years Fireworks

20 minutes of video compressed into a 1 minute timelapse.

Jan 21, 2014

4096 X 2048 pixels, 142 MB, 1 min

The video is presented as an Anaglyph full spherical panorama of 360X180°. I converted first to B&W because the blue cast made it impossible to view correctly with the anaglyph glasses.

I was also testing the quality of locking the white balance of all the cameras to cloudy. I corrected for the changes the cameras make because of autoexposure but even with whitebalance locked, I should have also corrected for differences in whitebalance.

I have got much better at the aligning and stitching of the videos.


2013 to 2014 New Years Fireworks, Saint John, New Brunswick VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift


For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

2013 to 2014 New Years Fireworks

New Years Eve Fireworks to welcome in 2014. The temperature went down to -27°C that night resulting in a smaller turnout.

Part of the New Years Eve party put on by Market Square.

Jan 1, 2014

2304 X 2304 pixels, 325 MB, 14 min
1088 X 1088 pixels, 38 MB, 14 min

Black border is added to the panoramas to expand to full 360X180°.

Non interactive 2D videos on YouTube:

Stitched from 3 left cameras.
Timelapse from DSLR.


Christmas Day 2013, New Brunswick VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Sphere
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift


For anaglyph glasses:
Media -> format -> Mono
---------> projection -> Sphere
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

2013_Christmas_Day

Just before Christmas New Brunswick got hit with a major ice storm. The storm caused several thousand to be without power for many days. Here are some trees covered with ice. My dog playing in the snow and birds feeding and singing. The gas generator can be heard in the background.

Dec 25, 2013

2304 X 2304 pixels, 377 MB, 6 min

Black border is added to the panoramas to expand to full 360X180°.



Saint John, New Brunswick

VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection ->Dome
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 1.0
----------> Vertical coverage: 0.72

For anaglyph glasses:
Media -> format -> Mono
---------> projection ->Dome
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Projection
----------> Horizontal coverage: 1.0
----------> Vertical coverage:0.72

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Saint John in 3D

A few places in Saint John, New Brunswick.

Lost footage from one camera so the 3D effect is missing in 1/4 of the image.

Dec 1, 2013

3856 X 2168 pixels, 203 MB, 3 min
2848 X 1600 pixels, 91 MB, 3 min

The panorama height is cropped.



Backyard VRPLAYER SETTING:

For Oculus Rift:
Media -> format -> Over/Under
---------> projection -> Dome
---------> Effect -> None

Device -> Layout -> SidebySide
----------> Distortion -> Barrel
---------->Tracker -> Oculus Rift

Tools->Plugins->Projection
----------> Horizontal coverage: 0.49
----------> Vertical coverage: 0.53

For anaglyph glasses:
Media -> format -> Mono
---------> projection ->Dome
---------> Effect -> Anaglyph

Device -> Layout -> Mono
----------> Distortion -> None
---------->Tracker -> Mouse

Tools->Plugins->Projection
----------> Horizontal coverage: 0.49
----------> Vertical coverage: 0.53

Tools->Plugins->Effects->Anaglyph
----------> Stereo mode -> Over / Under
---------->Anaglyph type -> Red-Blue

Backyard in 3D

An early experiment.

8 evenly spaced outward pointing cameras covering about 180° with about 142° in stereo. Left side of each camera created left pano, right side of each camera created right pano.

The seams are too visible. Even though the cameras are synced to the nearest frame of 30 fps there is still some sync problems.

Perhaps better cameras with genlocks to ensure perfect sync would show this to be a superior method, but with the inexpensive Mobius cameras it does not work so well.

Nov 19, 2013

3104 X 3360 pixels, 137 MB, 1 min

The video is presented in an Over/Under partial Dome view with one panorama for each eye. The panorama height and width are cropped from the full spherical view.

After Vi Hart posted about Panoramic Twist I got excited to see what I could do again with this technique.

This was an early experiment shot in the Fall of 2013, but I restitched it in June 2014 after much practice at stitching 3D multi-sensor video. It turned out much better than the first time.



 

Page last modified Aug 25, 2014
All content is ©1991-2014 All Rights Reserved.
All trademarks are property of their respective owners.