Submission C: practical application

Future is near or possibly already here. It was physical reality. Then it was virtual reality. Now it is augmented reality. Augmented reality is the mixture of the physical reality and the virtual reality.  It can be described as hybrid between physical and virtual reality. Augmented reality was introduced not long ago. Many questions have been raised. How much impact this will make is one of those questions. In order to make great impact on our living, this technology needs to be generalized. To make faster generalization progress, it needs to reduce user’s discomfort when they are using it. If the new technology is making more of discomfort than comfort, then it will disappear or take longer time to be generalized within our living. Good and bad generalization progress example can be found near us. This example can be found between Compact Disk and Mini Disk. Both media was expected to be next generation of storage, however only one of them managed to survive. Compact Disk was generalized successfully and has been making impact on our living since whereas Mini Disk disappeared not long after its introduction. Normally it takes time for the new technology to be generalized among people and other field of technologies. If it tries to do more than what It is capable to do then it will only cause discomfort and people’s bad perception. People’s perception on new introduced technology is one of key to make successful generalization. This is the point that I have been concentrating on. I have been trying to make the most of this augmented reality technology using ‘Junaio’ without making any discomfort. In other words, for example I do not want it to show high-end 3D moving image to show off its potential when it needs couple of minutes to load it. I would rather use simple 3D geometry to help my design presentation straight away, which doesn’t even need number seconds to load those 3D files. I have been trying to maximize augmented reality technology’s practicality within given circumstances such as Internet speed and smart phone camera’s lens quality. This document will introduce my journey of experiments to find that optimum condition.

 

Initially I planned to improve instantaneity and practicability of this new technology called augmented reality in our everyday life. To achieve good practicability, I planned to adopt this for architectural presentation. To improve instantaneity, I planned to cut loading time of artifact. Below story from my previous post describing how my initial proposal was.

‘Boy A has an architectural presentation tomorrow morning. He made a house model. He has a house model to present but he wanted to emphasize more in detail of the house rather than exterior, which is already presented by his model. It’s going to be a free flowing presentation this time so there is not a set time for him to present his work to everyone. So he decided to use 'Junaio' augmented reality technology for people and critics. By using this he won’t have to repeat what is inside and how it was constructed also he won’t have to spend time on explaining model’s interior and details. He assigned simple detail drawings and floor plan to specific point of the model so when people looking at particular spot with their smart phone they can understand what is behind and how it was made. He was concerned about loading time, as there is no Wi-Fi available at the venue but 3g network. So he decided to use simple smaller 2D image file to minimize loading time.’

Above was the starting point of my experimental journey. One of my key points of initial plan was the faster loading time of artifact. To achieve it I used 2D plan rather than complicated 3D model. However during my experiment, later it was found there is not significant loading time difference between 2D and 3D artifact since 'Junaio glue' restricted file size to be within 1mb. 500kb was given for 3D artifact and 500kb was given for texture. By this time I could decide to change my plan to use 3D artifact rather than 2D artifact. I also realized when further heavier file is needed that can be uploaded into Internet as 'Junaio' can assign link with tracking image.

From the initial plan up till now I have been experimenting various possibilities. During my journey I found that various factors such as type of device or speed of Internet influence Junaio’s stability. The fact that I found for speed of Internet was when I used 3G network or ADSL Wi-Fi there was no significant problem. However when the device connection dropped down to 2G it took more than half of minute to load 450kb 3D artifact. The other factor that I found during my journey was that there is different stability exists among different devices for 'Junaio' recognition. Among devices of Iphone 4g, Iphone 3gs, Ipad 1 and Android tab, I found that Iphone 4G worked best to recognize tracking image and Android tab was found to be the worst at it.

During my development my Iphone 4G found it hard to recognize 3D tracking model. At first, I assigned 2D artifact (plan drawing) onto 3D tracking model. I did this at school studio. It worked fine when I tested it at school studio. However Iphone could not recognize this 3D tracking model when I came back home. I found different light condition influence on phone camera’s recognition. Later it was realized 2D tracking image works better than 3D tracking model. The Difference between 2D tracking image and 3D tracking model is that 3D tracking model has contour, which cause light and shadow effect. 2D tracking image doesn’t have contour and is not affected by light as much as 3D tracking model.

At this stage I needed to change my tracking medium from 3D tracking model to 2D tracking image. Up to this stage throughout my experimental journey, 2D artifact had been changed to 3D artifact, as there was not much difference in loading time between them. Also 3D tracking model was changed to 2D tracking image due to 3D tracking model’s contour which is causing light and shadow effect. From this stage I have been trying to find further optimum condition to achieve smooth architectural presentation. 

Tracking image plays very important role since camera need lots of contrasting hint to recognize it. During my experiment and discussion, it was realized that tracking image needs extra border space for camera to recognize it better as well as number contrasting colours helps too.  

Doorway was picked for making tracking 2D image.

I choose one spot of plan drawing to make tracking image. I deleted blurry detail to maximize bold line. Then I coloured it. At the end I put red square bolder line to make contrast. Last tracking image was worked best with smart phone’s camera for recognition.

Development of tracking image from original doorway plan drawing for better detection.

Above ultimate tracking image was tested for 'Junaio' detection during day time and it worked fine in school workshop. However at night, when workshop’s lighting condition had been changed, Iphone’s camera started having trouble recognizing tracking image. My initial tracking image was from Photoshop. It does not contain any sort of light and shadow effect on it. It is original clean tracking image. During daytime the tracking image was not influenced much by natural light, however at night time tracking image was heavily influenced by artificial light and this was the reason why Iphone couldn't detect the tracking image at night.

Original 2D tracking image from photshop.

Iphone's camera started to not detecting tracking image when light condition was changed.

Then I re-assigned same image but this time the image was taken from Iphone. By taking same image using Iphone gives better possibility for it to recognize since camera is detecting tracking image through its lens. So image that was taken by lens will work better than original Photoshop image.

Tracking image created by Iphone's camera.

Iphone started to detect tracking image.

Pop up menu when 3D artifact was touched.

 

The other fact that I need to consider was that the interrelationship between 3D artifact and the angle of device’s camera. When the camera looking at tracking image straight, assigned 3D artifact tend to pop up easily. However when I started to tilt the camera it tends to disappear. It was found that 'Junaio' is very unstable when it comes to angled camera. This makes users to experiencing difficulty to view the 3D artifact on an angled position. So the coordinate of 3D artifact needs to be controlled according to this restriction. For example if presenter wants to show 3D door way, then the 3D door way façade should facing opposite to tracking image so users can view the details of void space that presenter wants to show.

Bad example of assigning 3D artifact as viewer cannot see the actual entrance void space.

Better example than above as viewer can see the void space.

To maximize the content of information the plan can provide, I put some details into tracking image, which means tracking image also has its own additional information for its viewers.

Example of tracking image that doesn't contain much of information.

Better example than above. Tracking image which contains additional information of plan drawing.

 

So when the viewer sees this tracking image, it is already providing information of 2D perspective drawing. Then when the viewer applies 'Junaio' camera on it, actual 3D artifact appears. Viewer can obtain more of information when the 3D artifact appears.

3D artifact appears and viewer can see the void space of doorway.

Below is how I want to use 'Junaio' technology for architectural presentation. Below is my ultimate proposal of architectural presentation using 'Junaio'.

From above plan drawing presentation, viewer can obtain the information of plan drawing as well as perspective drawing of specific area.

At this stage viewer can obtain the information of plan drawing and perspective drawing of doorway. If the viewer wants to obtain more information of for example doorway then the viewer can use 'Junaio' to find more detail of it.

 3D artifact appear as soon as viewer uses 'Junaio'.

When the viewer touches 3D artifact, detailed description with website link button appears.

When the viewer touches web link button,' Junaio' connect to website that shows detail drawing of specific area of plan. For above example it is doorway. So by using 'Junaio', the viewer obtained the information of plan drawing, perspective drawing, detailed description and detailed drawing without presenter's explanation. By using 'Junaio', the viewer can obtain whatever information whenever the viewer wants without presenter's help.

  

Above is my ultimate proposal for our everyday architectural presentation. Augmented reality needs more of refinement for sure, however we still can make the most out of it as I explained. There still are some of down side of 'Junaio'. One of the most significant downside of 'Junaio' is that camera’s recognition ability. The camera of the device is too sensitive to create stable flow for users. Also tracking image is influenced by different light effect. Despite above downsides of 'Junaio', it is still developing and refining technology with huge potential of impacting our life. By using this 'Junaio' augmented technology for my presentation, it creates some sort of buffet of information for viewers. What it means is that viewer can gain whatever information whenever they want to without presenter’s help. To conclude this journey, I would like to insist that the augmented reality technology has huge potential of benefiting our life.

Relevant links

http://www.youtube.com/watch?v=LHWww8hUp5s


http://www.youtube.com/watch?v=_6FMABGBMjY&playnext=1&list=PLD5293A72A9A36595


http://www.youtube.com/watch?v=U0AhIxhZCSQ&feature=related


http://www.youtube.com/watch?v=fnuMiN1HPdE&feature=related

Difference between 3D & 2D recognition of 'Junaio'

This video clip is revealing how 'Junaio' tend to work better with 2D tracking image than 3D tracking model. The difference is that 2D tracking image has flat even surface for camera to recognize better (it also has less light and shadow interference than 3D) but 3D tracking model has uneven contour, which cause different shading effect by different light system and angle. This light and shadow interference on 3D model cause trouble for 'Junaio' to recognise its tracking model. (Surround condition such as light angle and shadow are changing once you move your 3D tracking model from its original place). For this case, I initially took a photo of 3D model in studio. It worked fine in studio but it doesn't work at my home. (Different light colour and angle between studio and home)
 

Submission B Prototype and Report: the evolution

We are the generation who started to conquer new millennium. Living in new millennium benefits us to experience various the most advanced technologies. Rapid evolutions of technologies are faster than ever. 

'The porch dog' project
Top: Reality
Bottom: Virtual Reality

At first it was just reality. Then virtual reality was invented to advance our living in various ways. Now it is time for augmented reality. Augmented reality is mixture of virtual reality and our physical reality. Augmented reality can be thought as hybrid reality between our physical reality and virtual reality. When virtual reality technology was introduced, not many people would expect how this technology can advances our living. Now virtual reality technology is generalized and used in various field. For instance, we experienced how ‘Second Life’ can be used for student in architectural field. For now augmented reality is new. It has not been refined and still developing. However it cannot be denied that augmented reality has enormous potential as virtual reality has been benefiting human existence.

Augmented Reality

Since the augmented reality is new I initially planned to make the most out of this technology within its limit. My main focus was practicality of this augmented reality in architectural field. I have been experimenting how this can be used practically. To experiment practical side, I planned to adopt this technology to present architectural model to people. My initial concern was the loading time, which is one of the biggest down side of this augmented reality application program called ‘Junaio’. To shorten the loading time of assigned artifact, I planned to use 2D artifact such as plan drawing. It was later found that there is no significant difference in loading time between 2D and 3D artifact (both of these were loaded within 10 seconds in 3G network). This competitive loading time of 3D artifact was achieved by ‘Junaio’, which restricted 3D file size to be within 1mb of size (500kb for md2 file and 500kb for texture). So I changed my plan from using 2D artifact to 3D artifact. When heavier file such as 3D animation or complex model need to be used, these can be uploaded on Internet as ‘Junaio’ can assign link with tracking image.

When touching the 3D artifact, link of web page was appeared.
So heavier file can be uploaded on Internet and assign link to 'Junaio'. 

It was found during my development, the stability of ‘Junaio’ is influenced by various factors such as the speed of Internet and type of device. I used both 3G-network Wi-Fi connection and ADSL Wi-Fi connection. There was no sign of problem when the device was connected to 3G network or ADSL network. However when the Internet speed dropped to 2G-network, it needed huge patience for loading time (It took more than half of a minute to load 450kb 3D model).

Type of device was also the key factor for ‘Junaio’ presentation stability. When the device has better camera, ‘Junaio’ tend to work better. Iphone 4g worked best during my development. Android tab was found to be the weakest device to work with for ‘Junaio’. Iphone 4g recognized every time but more than 50% of time Android tab had trouble recognizing tracking image.

Even though I used 3D model for tracking image during my development, I had to transform this into 2D by taking photo and assigned as tracking image. My initial proposal was to use 3D model as tracking image and 2D detail drawing as assigned artifact to model. Since loading time was not significantly different between 2D and 3D artifacts, I changed my plan to adopt 3D artifact, which need to be within 500kb limit to be used in ‘Junaio’ channel.

Difference between 2D tracking image and 3D tracking image. 

3D tracking model tend to be affected heavily by light,  which is causing shading effect.

After this stage I experimented on finding the interrelationship of camera and 3D tracking model on recognition. It was found to be very difficult to achieve acceptable level of recognition (I defined more 80% success rate as acceptable level of recognition) with 3D model. Reason was since it was 3D model, it doesn’t have flat even image for camera to recognize. 3D model was heavily affected by light. Light cased different shading effect on 3D tracking model through the day and night (flection and contour of 3D tracking model cause heavy shading effect). 

Different light influence creating different shade effect. 'Junaio' is having hard time on recognition.

'Junaio' recognize 2D tracking image better even with different camera angle.

Sometimes ‘Junaio’ recognize the 3D model but more than half of time during the day ‘Junaio’ could not recognize 3D tracking model. Therefore to achieve my goal of practicality in real life I changed my plan to use 2D plan as tracking image. 2D artifact does not have flection or contour to cause shadow. 2D artifact is flat and even. It was the best option for me to achieve my goal. My goal is becoming clearer by this stage. I want ‘Junaio’ to be fast and accurate. If not perfect, as perfect as it can achieve.

Simple 3D artifact exmaple
image from 'Brooklyn Digital Foundry'

Complex 3D artifact example

Since complicated detailed 3D model (for example sky scrapper with every surface detail) cannot be achieved within 500kb of size. I found simpler and meaningful model would be better to use for my case.

Simple 3D wall model is appeared on bathroom floor plan

Up to this stage I have been using 3D timber wall artifact to pop up on floor plan so people can understand how the 2D floor plan will become 3D reality when it is made. Fabrication of 3D model will be more refined at the end. For now I used simple timber wall 3D artifact to find the optimizing condition for my ultimate presentation.

2D artifact is appeared on 3D tracking model

At this stage various things have been changed during developing sessions. Initially I tried to achieve 2D artifact assigned to 3D tracking model. My initial idea was expressed in my previous post in my blog. For now after evolution of my initial proposal, my key goal has become more specific. I want ‘Junaio’ to act faster and accurate within its limit. To achieve this I changed 3D tracking model to 2D tracking image (better accuracy). I changed 2D assigned artifact to 3D artifact, as there was not much difference in loading time.

Experimenting the interrelationship between 2D tracking image and assigned 3D artifact

Below is the kind of situation that I wish to achieve at this stage.

‘Architect A is presenting floor plan to client. Client looking at floor plan then check it again with ‘Junaio’ to see how this floor plan becomes 3D reality. This is the situation I am planning to achieve.’

From now I will concentrate working on achieving the most informative and effective 3D artifact within the limit of ‘Junaio’.




Useful reference link:
http://www.brooklynfoundry.com/index.php?p=bdf3&id=1783&gal=2161

Practical use of augmented reality.

Quite interesting practicability of augmented reality. Really helping people.

http://www.youtube.com/watch?v=P9KPJlA5yds&playnext=1&list=PLCA27BFD3B89EB3CB

Augmented Reality: Collage

This is the ultimate picture of my proposal.

Student (or architect) has model to present.

Critics (or clients) come to understand the proposed architecture model. Exterior looking good but people need to know the construction detail or interior detail in order to gain better understanding.

Augmented Reality technology is adopted to help people to understand the design and architecture in detail.

This is the ultimate picture that I want to achieve.

Augmented Reality: Prototype

Initially I tried to assign plan drawings on model. I applied little 3D flavour into this 2D plan drawings. Instead of assign this model onto 2D picture, I assigned it onto 3D contoured model and it still works fine. This worked out well and it has huge potential. For the matter of loading time, it didn't take that long to load this level of complexity as it was on University's  Wi-Fi internet connection. I plan to find out the relationship between complexity of the model and loading time in different networks.

Augmented Reality: Report

Project Name:                                        Left hand 

PARTICIPANT Names:                            Tommy Jae Wuk Shin 1027539

‘Boy A has an architectural presentation tomorrow morning. He made a house model. He has a house model to present but he wanted to emphasize more in detail of the house rather than exterior which is already presented by his model. It’s going to be a free flowing presentation this time so there is not a set time for him to present his work to everyone. So he decided to use Junaio augmented reality technology for people and critics. By using this he won’t have to repeat what is inside and how it was constructed also he won’t have to spend time on explaining model’s interior and details. He assigned simple detail drawings and floor plan to specific point of the model so when people looking at particular spot with their smart phone they can understand what is behind and how it was made. He was concerned about loading time as there is no wifi available at the venue but 3g network. So he decided to use simple smaller 2D image file to minimize loading time.’  This story tells about my proposal. My idea is about how I can improve instantaneity and practicability of this new technology in our everyday life. Instantaneity of loading within presentation plays big role. Longer loading time won’t attract people. And to achieve better practicability I apply this idea into our everyday life presentation. Cutting loading time and not so complicated (e.g 2D plan, smaller 3D model file) virtual reality will minimize new users antipathy against new advanced technology. 



asdf