Deutsch
English
It seldom happens that we feel special while testing a new app. Most programs are neat and offer some benefit but fade into oblivion all too soon. This even applies to Google that frequently put out apps that will be all forgotten about the following day. Google Lens, which has now been available on Android and iOS for a few days, might be the exception and soon become a part of many people's daily lives. Reason enough to give the app a go!
Google Lens(GL) is part of Google Assistant and was initially only available on their own cellphones. Now, the feature has been made available as a separate app (Android 5 and highter) and built into Google Photos (iOS). Here's how it works: GL has full camera access and detects objects either in single shots or camera live recordings through image and text recognition. When you spot something that might be of interest, you simply tap the object in question and GL will present you with additional information retrieved through Google Search. What may sound boring at first actually makes sense. Here's an example: as I am taking a shot of a book, I'm not only shown the title but also information about reviews, related movies and, naturally, stores that carry the item. I even get the option to access the associated audiobook through Spotify. GL also interfaces with other installed apps (magazine readers, YouTube etc.) and augments search results accordingly. In another test, GL recognized the Eiffel Tower and instantly showed me opening hours and admission fees. Not bad!
I also appreciate that Google Lense has an artistic sense offering useful information for paintings and sculptures. Bar codes are also supported, instantly obviating the need for an entire range of apps. But nothing beats a field test which is why I took the app on a tour through my house. I checked out our clothes first! Amidst silent protest from my better half, I rummaged through her wardrobe and took photos of ten pieces of ther clothes. It soon became apparent that big brands are quickly recognized including the option to reorder them or buy similar items. Business cards is where things got really interesting. GL instantly recognized them and offered to add them as contacts to my address book. Makes perfect sense! When you look at flowers, the app obviously turns into a real nature lover. Out of the eight plants in my home, five were recognized and the app even managed to distinguish between various plants of the genus hydrangea. GL appears to also know a lot about dogs, only mongrels (like my neighbors' dog) threw it off a little bit. At least it understood the creature was a dog. Thankfully, it knew nothing about the dog's proclivity for ear-shattering barking and calf biting.
Then, as I took a photo of a co-worker, the app just remarked "I'm sorry. I can't help you with that." That's exactly how I feel when I see him! But back to the topic... The app isn't perfect by any stretch of the imagination yet! Not only does it refuse to work on some cellphones but many objects are incorrectly recognized, if at all, and it takes some luck to hit the one spot that reveals the most meaningful information. Often, the results are just weird. A random shot from my balcony supposedly depicts a run-down restaurant in Mumbai, India. I'd better not tell the neighbors! Likewise, the angle at which shots are taken and object dimensions play an important role. For instance, GL struggles with bottle labels because the surface is cylinder-shaped. There's definitely room for improvement there. In other cases, the information presented is just useless. When I take photos of toys, I expect a little more than just the information that I'm probably looking at toys. Maybe the toy in question is missing from Google's database, as are so many old books, apparently.
GL still has a long way to go to become the super app Google would like it to be. At present, it can't handle road signs with foreign characters (I had expected more) and the app frequently seems to rely on guesswork with frustrating results. Text recognition and translation are also quite flaky with entire passages often remaining untranslated. The video commercial for the app painted a more rosy picture. As much as I find "it shall be" a thought-provoking description while looking at a garden chair through GL, poetry is neither the app's strong suit nor should it be. The app is also puzzled by handwriting which is a real shame. Also, some product categories apparently haven't been added yet. It works fine with fashion items and car parts but can't really make heads or tails of radios, headphones or Blu-ray players yet, simply calling them "audio". But just like with Google Maps which had a few initial teething problems, I expect great things from this app in the future! It would be a perfect fit for the visually impaired or the many users who struggle with their cellphones.
A pain in the past, a boon in the present: Google Maps
"Which permissions does the app require?" I hear you ask. We're talking about Google! Seriously, the app needs wide-ranging permissions which, to me, makes perfect sense in this particular situation. To use GL like an assistant, access to the camera, Internet and phone contacts are a given. Why the app needs voice and audio access is less obvious to me, though. Maybe, we'll see these capabilities utilized in future app updates. As always, it's up to you to decide whether you want to use GL. And, as always, skeptics are already suspecting another attempt by Google to learn all our secrets while supporters praise the enormous positive impact the app may have on our lives, calling it a true revolution in the cellphone business. I for one take a more sober stance, as always, but I do believe the app will be used by millions and marks the beginning of a new breed of applications!
What I would like to know: do you have use for Google Lens or do you fear feeding the data kraken even more of your personal data?
Once you use Android device, such as phone or tablet, which is a definite Google designed Operating system, Google has you in the palm of their hands, and your privacy out the window. For example: A new Android phone I just purchased, cannot be used at all, until I have supplied it with all my eMail details. Then it demanded WI-FI to be listed... which I don't have. While you are given the option to SKIP this option, it returns to the WI-FI demand again... I had this phone back to the seller a few times, and they managed to go past the hurdle using their own WI-FI....
However, I find Google very intrusive, giving you Claytons choices, (that is the drink , when you are not having a drink!). For example, When I go to the News TV Channel, and they offer videos to watch, I click on the video, instead of the video playing, I get a Goggle screen, informing me that there is a new YouTube app available, and the only option given is : INSTALL. If you refuse that, you cannot watch the video! Goggle also informs me that this update requires permission to use : Your Personal data, your Camera, your Microphone, your Location, ... etc. Why on earth does a YouTube player need my Location, Mic, personal data and my Camera? I am sure it is not YouTube, but Google that wants all this, for their Snooping purposes... the next demand was for me to update to their New Chrome... letting me know that they already have access to all my info, camera, location, mic etc. What do you think? Would an Apple iPhone, although more expensive, be less invasive, and get Google out of my life?
I would really like to see more of the plant and even spiders insects. Could come in handy.
I could be interested depending on price. I would certainly like to follow the development.
You can get the app for free but I expect Google to eventually release a new form of Google Glasses with similar technology.
Hi Sven,
Thanks for the advice, although now available to Androiders I lack interest in yet another 'app' that shortcuts what humans can physically research if the need be so.
As I like to consider what this GL 'app' is capable of leading to in the future I believe it can become a spy on innocent and/or unwary people in our society.
Police, other protection and detective agencies are already using facial recognition almost everywhere in the world from computers in their offices and I have no doubt that the GL 'app' can be programmed to perform the same way in the near future.
My trust in Google, Facebook and most 'apps' et al is zero.
Vielen Dank Sven.
I wonder if the app's need for audio might have to with some future aspect--recognizing music or a contact's voice.
It sounds as though Google Lens will carry out some of the functions that were originally planned for Google Glass. Glass was not enthusiastically received when it was first launched, probably because it seemed like an excessive intrusion on many aspects of our personal information and behaviour.
I wonder whether Lens is a somewhat watered-down version of the Glass principle, designed to soften the feeling of intrusion that Glass conveyed to us, and to give the impression that Google has a more benign, softly-softly approach to harvesting our data. Then, when we've got used to Lens, Google can start to ramp up that harvesting to a more comprehensive level.
Or am I just a bit paranoid?!
I would’t call it paranoid at all. People tend not to throw away finished program code but to use it in some other way instead. And Google Lens could be just the first step in a series of products – or another attempt to collect more data.
Enjoy your blog always very interesting and thought provoking. This technology excites me particularly if combined with Google glasses. Information overload or mind expanding potential like a brain/computer interface.
Nice writeup Sven.
For me, it's thanks but no thanks.
While the technology is certainly very useful, under the control of Google, I won't trust it. I would expect that at some point, compaines thay pay Google more will have more focus from the lens, and it just turns into another way to track people caught up between online and offline living. Another point is that it might end up being another way of pushing ads: take a picture - here's an ad to buy more.
I believe strong financial interests play a role here. Currently, many companies are likely working hard to publish product images online to ensure they will be recognized by Google Lens. :)