When I tried using the app, It didn't get the best results when using the AR camera. As you can see in the pictures above, most of the text wasn't able to get picked up. It's scrambled to get most of the words and the words it did pick up it wasn't translating the best. This might have to do with the lighting or that because the label was made of plastics, it was reflexing light onto the camera so it wouldn't be able to read the letters. When I scanned the CTA sign on the train, I was able to pick up most of the Spanish that was written there. I also noticed that when it takes a picture and scanning it, it's able to pick up more words then it was in real-time. With the words that got picked up, you can highlight the word you want to be translated and it will stay as it said in English on the top.
The most effective use of this capability is when traveling to a foreign land. For example, I went to a Koran market. Here, they had a lot of food with Koren written on it. With this VR app, I was able to look at what certain items are and what they were called in English. More importantly, I can look in the back to see what ingredients the are in them, in case other people have a food allergy.
Another great use of this app is that it can be used for tourists. When they go to a museum, they can use the technology in order to read the displayed information in their own language. When they are out at a restaurant, they can use the games to read the menu, granted they can not say what is on the menu but they would still be able to identify what an item was and pick it.
this would also give people the ability to read books that are in a completely different language other than their own. If they have access to a different language of the book, they can simply use the app to change the language, without having to buy a completely different book
With augmented reality glasses, then it might be powerful enough to be able to pick up every word it can find. As mentioned before some cons with this are that it is not the best at picking some stuff up. If the writing was written in a cartoony way, the google translate wasn't able to pick it up even thou it was written very big. On the other hand, if the technology was more powerful and updated, then it might be able to pick up and translate everything. Another con to this is that if the person has to already wear glasses, they will have to wear contacts or wear glasses over glasses. The pros of this are that the user might not need to learn a new language when traveling and you might not need to pay a tour guide since you can read all the signs around you.
I believe that the users should have very limited control over this. It could be used for bad such as making people see things that aren't there. An example of this is reading something that wasn't translated right like a street direction be wrong and getting lost because of it. The same with the ingredients example, if someone changed it so that something that is in there but not translated to say it was, then a user might have a bad reaction to the food. So having restrictions on these kinds of things would be most wise.