It Can See?

It’s official: ChatGPT can now see.

ChatGPT-4V has at last (had to wait two whole weeks) been made available in Europe. Lets just say that it seems to be a huge leap forward. It is truly multimodal. Here are just a couple of things that I have been able to do since I got access on Thursday evening:

I received an image taken from a clients mobile of her lawn not draining away during heavy rainfall. I uploaded the image to GPT4V and asked it to tell me what has caused this and how to fix it. Here’s the photo:

It correctly identified that some of the turf looked distressed and that the lawn had been recently laid (the client nearly totally lost the lawn as it was laid in summer and they immediately left for a long weekend - luckily, we were able to save it. Just). GPT4V then described to me all the things that could have caused it and some very sensible things to do to fix it, including aereating the lawn and top dressing with a sand mix.

I then gave it this picture from a recent trip to Vienna:

I simply asked it: where am I and where is the best place to eat local food. Here’s ChatGPT-4V’s reply:

“The image features the iconic Wiener Riesenrad (Vienna Giant Wheel), located in the Prater amusement park in Vienna, Austria.

For local food in Vienna, you have a plethora of delightful options. Vienna is known for its Wiener Schnitzel, Apfelstrudel, Sachertorte, and other Austrian delicacies. Near the Prater, here are a few recommendations:

1. Schweizerhaus: Renowned for its Stelzen (roast pork knuckle) and beer, it’s a popular spot with both locals and tourists.

2. Café Restaurant Residenz: Located a bit further, near Schönbrunn Palace. They’re known for their Apfelstrudel show, where you can watch bakers make the famous dessert.

3. Figlmüller: Famous for serving arguably the best Wiener Schnitzel in Vienna. They have a couple of locations in the city.

4. Café Central: Historic coffeehouse serving traditional Austrian pastries and meals. Famous figures like Freud and Trotsky frequented this place.

Always check the latest reviews or websites for opening hours and to make a reservation if needed. Enjoy your culinary journey in Vienna!”

Pretty impressive don’t you think?

Here is an excellent video that gives examples of GPT-4V in action:

I hope you’ll get the chance to use this tech. It seems like a game changer to me and I intend to experiment with it lots. If you look at some of the things that Kris tried in the above video you’ll see some of the amazing things that I intend to work on. Go on, give it a try. Enjoy the journey!

That’s all folks! See you on Wednesday with more news from the fast changing world of AI.