3D Internet Service Pilot Taking Shape

Report
NIMO
Nordic Interaction and Mobility Research Platform
Professor Timo Ojala
University of Oulu
Department of Computer Science and Engineering
MediaTeam Oulu research group
Finland
Sep 19, 2012
NIMO (Nordic Interaction and Mobility Research Platform)
• http://www.nimoproject.org
• Timespan: 6/2011 – 5/2014 (36 months)
• Consortium
• Luleå University of Technology, Sweden (LTU) (coordinator)
• University of Oulu, Finland (UO)
• University of Lapland, Finland (UL)
• Total budget: 1.45 MEUR
• Main public financier: Interreg IV A Nord program
• UO budget: 285 kEUR
• Co-funders: BusinessOulu, OBP Research Ltd.
UO objectives
• Open 3D virtual model of Oulu
city centre (”Oulu3D”)
• Pervasive city game for youth
NIMO: Advisory group
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Kari Autio, UO / CIE
Tommi Hollström, Adminotech
Jussi Kangasoja, OUAS
Jarmo Laitinen, City of Oulu / Center of Youth Affairs
Uki Lahtinen, City of Oulu / Technical Centre
Tony Manninen, Ludocraft
Ville Mickelsson, Cyberlightning
Juhani Miettunen, Nokia
Pekka Nisula, OUAS
Timo Ojala, UO
Ilpo Okkonen, Oulu3D
Jyrki Okkonen, Nokia
Johannes Peltola, VTT
Harri Pesola, Codemate
Jani Pirkola, Cyberlightning / realXtend Foundation
Toni Piirainen, Codemate
Janne Salmi, CubiCasa
Mika Sorvisto, CENTRIA
Christian Sundell, Business Oulu
Eero Tervo, Evocons
NIMO: UO WP3 objective #3-1: Oulu3D
• Joint initiative to build open interactive 3D virtual model of
downtown Oulu atop the realXtend platform
• Outdoor modeling of selected blocks
• Indoor modeling of selected key buildings
• Hosting of the model in public Internet
• Phasing of the model
• Phase #1: ”9” (available in 2012)
• Phase #2: ”50” (available in 2013 if additional funding is obtained)
• Phase #3: ”City” (available in ?)
• Division of activities
•
•
•
•
•
Data collection (photographs, blueprints, laser scanning)
realXtend modeling
Hosting of the model
IPR and O&M of the model
Utilization of the model
realXtend - Open source platform for the 3D Internet
•
•
•
•
http://www.realxtend.org
Client-server architecture
Tundra SDK, Naali viewer
Extensible scene architecture
Example shared presentation
Alatalo T (2011) An entity-component model for extensible
virtual worlds. IEEE Internet Computing 15(5):30-37.
Oulu3D: Phase #1 area (”9” blocks)
Oulu3D: Phase #2 area (”50” blocks) (tentative)
Oulu3D: Modeling process
NIMO
CENTRIA
DATA
3D
MODELING
TEXTURING
MOVE MODEL
TO REALXTEND
ADMINOTECH
HOSTING OF
REX MODEL
Oulu3D: Photographing of building facades
Pakkahuoneenkatu 14 facade south
Oulu3D: Photographing of blueprints
Pakkahuoneenkatu 14 facade south
Oulu3D: Photographing of blueprints (2)
Pakkahuoneenkatu 14 floorplan
Oulu3D: Laser scanning
Laser scanning equipment
3D visualization of Puistola
block from laser data
Video
(30 seconds, disk)
Oulu3D: Laser scanning example (1)
Oulu market: Scan #1
Oulu3D: Laser scanning example (2)
Oulu market: Scan #2
Oulu3D: Laser scanning example (3)
Oulu market: Scan #3
Oulu3D: Laser scanning example (4)
Oulu market: Scans #1-#3 merged
Oulu3D: Laser scanning phase #1 (fall 2011)
50 scanning points
Oulu3D: realXtend modeling example
Which part is realXtend model and which part is photo? 
Differences between realXtend model (low polygon) and
CAD models (high polygon) have to be understood
Oulu3D: Current ”9” block realXtend model
Oulu3D: realXtend indoor modeling of buildings
Byström’s house
selected as pilot for
indoor modeling
Oulu3D: Hosting
NIMO purchases hosting from Adminotech (uses Amazon cloud)
3D Internet Organizations
Oulu3D: IPR and O&M model
CorpX www.corp_x.fi/3D
CorpX www.corp_x.fi/3D
CorpX www.corp_x.fi/3D
CompX www.compX.com/3D
CorpX Scene
CorpX Scene
CorpX Scene
CompX
Scene(s)
Server
Instance(s)
Cases
Server Instance(s)
Server
Instance(s)
(hosting
operator)
Server
Instance(s)
(hosting
operator)
(hosting operator)
(hosting operator)
streetartgangs.net
MCT3D.net
www.ouka.fi/3D
NIMO Scene(s)
MCT Scene(s)
City of Oulu Scene(s)
Server Instance(s)
(hosting operator)
Server Instance(s)
(hosting operator)
Server Instance
(hosting operator)
Oulu3Dlive.net
(Univ. of Oulu)
Commercial services
Nonprofit services
Administration (administrative operator)
Root Scene
Model
Elements
Root Model (Creative Commons)
NIMO
MCT
Company B
City of Oulu
Company C
Organisation A
...
REX Contributions
realXtend Server (hosting operator)
Oulu3D: Example of utilization in research
UO/CIE: ServiceFusion
Real-world online services are ”fused” into the Oulu3D virtual model
Oulu3D: Example of utilization in research
UO/CIE: Reality vs virtual reality in mobile AR UI
• Comparison of camera-based
augmented reality UI and
3D virtual model based UI
• Wizard-of-Oz testing at
downtown Oulu with
simulated location-based
mobile services
Oulu3D: Example of utilization in public service
City of Oulu: Urban planning (1)
Oulu3D: Example of utilization in public service
City of Oulu: Urban planning (2)
Oulu3D: Example of utilization in business
Cyberlightning Ltd.: CyberSlide
Oulu3D model as a virtual 3D presentation environment
NIMO: UO WP3 objective #3-2: Pervasive city game
• Pervasive gaming ~ seamless integration and
interaction of real world and game world
• Design and implementation of incremental
prototypes of pervasive games for youth utilizing the
3D virtual model
• Evaluation via game play by significant number of
real players in authentic urban setting
• Close collaboration with the upcoming MESSI project
of City of Oulu’s Centre of Youth Affairs
First pervasive city game ”Street Art Gangs”
• Teams of players try to create virtual graffitis around
downtown Oulu, at the same time stopping other
teams from creating graffitis
29
Street Art Gangs: Conceptual architecture
Street Art Gangs: Mobile client screenshots
Real (physical) game world at downtown Oulu
•
•
Game is played with a mobile client
Game objective is to create virtual graffitis around downtown
Street Art Gangs: PC client screenshots
Virtual game world in Oulu3D model
• Game is played in the Oulu3D model on a PC
• Players guide their teammates at downtown via instant messaging
Street Art Gangs: Snapshots from 3D world
Future work
• UO WP3 objective #3-1: Oulu3D
•
•
•
•
Operationalize O&M
Add first services
Release model to general public (Dec 2012 ?)
Obtain additional funding to build phase #2 (”50” blocks)
• UP WP3 objective #3-2: Pervasive city game
• Finalize implementation of Street Art Gangs ver. 1
• Conduct field trial with Street Art Gangs ver. 1
Oulu3D has brought the players together!
Objectives
• Open
• Community-based
• Comprehensive
• Realistic
Utilization
• Business
• Public service
• R&D
Visible landmark for
• Oulu’s 3D Internet competence
• realXtend platform

similar documents