I.H.L.A MEDIA Christopher Fuller, Nicholas Johns, Ashley Kaufman, Brandon McCauley, Matthew Pachol, Christopher Suever PROBLEM STATEMENT Wish to examine what it takes to create a seamless experience between an individual and technology Through the use of interactive “mirrors”, our objective is to get the observer to interact with a pre -designed interface and allow them to have control over the outcome that would create a memorable experience Applications for our proposed design would be through it’s use in advertising and entertainment purposes. PROBLEM BACKGROUND It is predicted that spending on digital ads will surpass the combined total of ad spending on newspapers and magazines ads in 2015 One of the biggest problems with digital advertising is a large varying demographic of customers Form of art that involves the spectator in a way that allows the art to achieve its purpose Immersive Environment: Real -time image processing and manipulation, biometric feedback and be aesthetically pleasing. MAJOR TECHNOLOGIES Raspberry Pi Single board computer CPU, GPU, USB AND HDMI Raspberry Pi camera module 5 mega-pixel for images 1080p, 30 frames/sec for video HD monitors LCD/LED monitors 720p or higher resolution HDMI compatible HARDWARE SPECIFICATIONS Micro-USB Power Port: 700mA (3.5W) HDMI 2.0: Up to 18 Gbits/s USB 2.0: Up to 480 Mbits/s Ethernet RJ45:10/100Mbits/s High Bit Rate SD Cards: 95 MB/s Raspberry Pi Camera: 1080p Monitor Display: At least 720p ARCHITECTURE OF SYSTEM LEVEL 0 Module Raspberry Pi: Model B, Raspbian OS Inputs Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection , > 15 Mbits/s Micro USB Power Port: 700 mA, 3.5 W, 5V DC Outputs HDMI Video Output: 1080p, 30 fps, Up to 15 Gbits/s Functionality Acquire and manipulate the camera input to produce HD video output. LEVEL 1 Module Camera Serial Interface Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection, > 15 Mbits/s Inputs Power: > 250 mA Outputs Functionality RPi Camera Image: 5 MP resolution Serves as the connection port between the Raspberry Pi and the Raspberry Pi camera to enable image acquisition. LEVEL 1 Module System on a Chip (SOC): Broadcom BCM2835, (CPU, GPU, DSP, SDRAM, USB port) RPi Camera Image: 5 MP resolution Inputs Power: 700 mA Outputs Functionality Manipulated RPi Camera Image: 5 MP resolution Integrates all components of the RPi module into a single chip. Serves as the medium between image acquisition and video output to manipulate the RPi camera image. Module High-Definition Multimedia Interface Inputs Manipulated RPi Camera Image: 5 MP resolution Power: 700 mA Outputs Video Output: 1080p, 30 fps, up to 15Gbits/s Functionality Interface for transferring the manipulated RPi camera image data from the HDMI-capable RPi camera to a compatible computer monitor in order to display the HD video output. LEVEL 2 LEVEL 2 Module Central Processing Unit: 700 MHz, ARM1176JZF-S core RPi Camera Image: 5 MP resolution Inputs Outputs Functionality Module Power: 700 mA Manipulated RPi Camera Image: 5 MP resolution Responsible for the pre-processing (resizing) of the acquired image data as well as performing image edge detection and contour finding. Graphics Processing Unit: Broadcom VideoCore IV @ 250 MHz, OpenGL ES 2.0 (24 GFLOPS), 1080p30 h.264 high-profile decoder and encoder RPi Camera Image: 5 MP resolution Inputs Outputs Functionality Power: 700 mA Manipulated RPi Camera Image: 5 MP resolution Provides openGL ES 2.0, hardware accelerated openVG, and 1080p30 h.264 high profile decoder and encoder. This controls the image data manipulation by use of algorithms including Shaders, Particles, and Grey-Scott Reaction Diffusion. OPENFRAMEWORKS High-level open source toolkit C++, object oriented Allows for direct calls to native system libraries MIT licensed: freedom of use in commercial or non commercial applications. Cross platform C++ interface to graphics, audio, video, networking and access to many libraries STRUCTURE OF OPENFRAMEWORKS Header file Blue print or empty structure with no implementation detail Cpp file Definition of functions and program. Setup() Allows for setting of program specifics prior to running the program (setting the windows size, frame rate, etc.) Update() Use for continuously updating the state of the program Draw() Allows for the interaction of the system. OUTCOMES Particle System Gray Scott Diagram REACTION DIFFUSION EXAMPLE CONTEXT DIAGRAMS USE CASES Standby Image Acquisition Image Processing User Image Meshing Output User SEQUENCE DIAGRAMS Standby Image Acquisition User System Camera Allocation Digital Image Success ImageAcquisition() SEQUENCE DIAGRAMS Image Processing User System Image Meshing User Output System System User Output to user Digital Image Image Values ImageProcessing() Image Values Success Applied Mesh Success Output() ImageMeshing() Success Return to Image Acquisition OBJECTIVE TREE EXPECTED OUTCOMES Task Description Members Hardware Integration Make sure hardware applications are compatible as well as work as a cohesive unit Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software Integration Making sure the programming languages and image modification algorithms are compatible. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Algorithm Design Create software algorithms to modify a user’s image in various ways. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Algorithm Implementation Test to determine whether the algorithms designed are functional and work to display the output. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Ensure that the hardware as well as software is compatible and work to display the output. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Create a working prototype that combines all prior tasks and works properly. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software and Hardware Integration Completed Prototype of System PROJECT PLAN CHALLENGES AND UNCERTAINTIES Integrating all technologies cohesively Designing multiple innovative unique display options Creating the system to work in real -time. Allowing the user with a free range of interactive possibilities Create a system at a low cost. Develop the system that has minimal power concerns. FAILURE ANALYSIS Activity Power Loss Software Failure Hardware Failure Environmental Issues System overheating Image output Failure Cause System experiences an Over-heating of the system external power loss. as well as the over consumption of power due to a single component. Code or software does Code has “bugs” or other not function properly. failures within or the software used is not compatible. Hardware does not Over-heating of the system work properly. or the connections between the components are not ideal. Lighting of the Too much or too little environment causes lighting for the system. The an issue within the space in which the system is system. in is not large enough for proper image retrieval. Solutions Allow for the system to be in an environment that allows for proper heating of the system as well as monitor the system’s power consumption. System over-heats causing a failure within the system. The image output quality is not ideal or does not work at all. Monitor the system’s power consumption. Power consumption of the Raspberry Pi or other components is too high. The image manipulation does not yield a output image that is ideal. Software, code or Raspberry Pi does not work properly. Determine if the code is “bug” and confirm that the software is functioning properly. Test connections between the components to determine if they are connected. Also to monitor the system’s power consumption. Allow for the system to be placed in an environment that is ideal for image retrieval as well as image output. A well lit room as well as a room that is large enough for image retrieval that does not compromise the system. Test the output of the system onto the monitor and determine if it’s both in as close real time as possible as well in the quality that is ideal. COMPONENT PROCUREMENT PLANS Raspberr y Pi Purchased from distributor HD Monitors Utilizing monitors that we have in our possession Camera Raspberry Pi Camera module purchased from distributor Openframeworks Obtained from Openframework website Visual Studio Obtained from Dreamspark website. CREATIVE AND INNOVATIVE ASPECTS Digital interactive art is a growing art form that incorporates science and technology. Immersive environment consists of human -computer interface which promotes social engagement from users. Complex algorithms combined with the level of interactivity leads to memorable and unique aesthetics. Incorporates STEM aspects into the market world. CONCLUSION Project is meant to be intuitive and aesthetically pleasing. Multiple uses such as advertising, art or just fun entertainment. Main goal: provide a memorable, unique and interactive experience for the user. QUESTIONS?