Tag: Image Recognition

Image Recognition – Salesforce AI Track Images on Social Media
AI, Einstein, Salesforce

Image Recognition – Salesforce AI Track Images on Social Media

The world of digitalization has made progress in various ways. Brands from quite long time could search for company mentions on social media, but they have lacked the ability to search for pictures of their logos or even products for that case in an easy way. This is where Salesforce’s latest Einstein artificial intelligence feature comes in action.

Today most of the company introduced their Einstein Vision for Social Studio, which ultimately provides a way for marketers to search for the pictures related to their brands, over the social media platform. In the similar manner, they search for various other mentions. The product is said to take advantage of a couple of Einstein artificial intelligence algorithms, including the Einstein Image Classification for image recognition process. It uses brand detection, product identification and visual search. It as well makes use of Einstein Object Detection to recognize the objects within images including the type and quantity of the desired object.

AI has grown quite good at perception and even cognition tasks in the recent past. One result of this has been the capability to train an algorithm so that it can identify a picture. With compute power widely available and lots of pictures being uploaded online, it definitely provides a perfect technology combination for even better image recognition.

Rob Begg, Vice President of product marketing for social and advertising products at Salesforce, says it is all about letting the machine loose on tasks for which the purpose is better suited. “If you think of it from a company’s point of view, there is huge volume of tweets and posts. What AI does best is help surface and source the ones that are relevant,” for an instance, he also says there could be some thousands of posts about cars, but only a handful of those would be relevant to your campaign. AI can assist you find those in an easier manner.

Begg has seen three possible use cases for this tool:

  • First, it could somewhat provide better insight into how people are using the products.
  • Secondly, it could also provide a way to track brand displays online hidden within the pictures.
  • Finally, it could let you find out when the influencers such as actors or athletes are practically using the products.

The product comes trained to identify two million logos, some 60 scenes, and more than 200 foods and 1000 objects. Customizing is not available in the first release, so if there is no logo or object included out of the box, you will have to wait for a later version to be able to customize the content.

It has been clearly stated that, it should be easy for marketers to use Social Studio to figure out the process of incorporating the visual recognition tools into their repertoire. The new functionality should be accessible instantly to Salesforce Social Studio users.

Image Recognition with the New Einstein Vision
Einstein Analytics, Salesforce

Image Recognition with the New Einstein Vision

Einstein Vision, a whole new launch of APIs for the process of building the AI-powered applications. No sooner this vision has been initiated that Salesforce is making it easier for you to embed the process of image recognition directly into your apps. In fact, rather than taking hands into entirely building and managing the specialized infrastructure to host the deep learning models, it is always better to simply connect to Einstein Vision’s HTTP/REST API for custom image recognition.

Now, every individual can avail the advantage of pre-trained image classifiers, or rather to put it in simple words, train their custom classifiers, to solve a huge number of image recognition. This is indeed done using cases, empowering all the end users across sales, and even marketing to be smarter and predictive.

Why do we need Einstein Vision?

Einstein Vision is used to discover all your products across all the social media channels. This is done to analyze the observational data in healthcare and life science applications. Accordingly, it will enable visual search in e-Commerce apps.

  • Visual Search – A way to expand your ways, so that your targeted audience can discover your products and thereby increase sales.
  • Brand Detection – A process to monitor all your brands across the channels, to increase your marketing reach and conserve the brand integrity.
  • Product Identification – This is a way you can identify your products and at the same time streamline sales processes and customer service.

The Algorithms behind Einstein Vision

It is true that the Einstein Vision utilizes the advancements made in the genre of deep learning and even an underlying architecture of the neutral networks. It is the way to classify images with absolute accuracy. This as well helps in utilizing multiple hidden layers to extract all the hidden features and assign the apt weights and biases to the feature output. There is always an input layer, where mostly all the images are fed, and even there was a hidden layer, which extracts each feature of the image’s contours, the shapes, and even the corners to predict new images eventually.

How does this vision work?

It is true that the Einstein Vision is a part of a supervised learning technique in which a model is thoroughly trained on the prelabeled training data. This training dataset consists of labeled images and is as well loaded into the Einstein via an API call. Then, a REST API call is made to train the dataset, and hence the output is a trained model ID. Finally, an API call is made to predict the label of a new image that has never been seen before.

Hence, the actual strength of the Einstein Vision is its ability to train custom models to completely to recognize the aspects you care about completely. These are some of the advancements in image recognition that are developing in the new era of customer success and enabling companies to predict the market research in a better way.

CEPTES offers a full range of Salesforce services

CEPTES provides a full range of Salesforce services from consultation to migration to implementation, support, and maintenance. For immediate contact, feel free to email us at contact@ceptes.com. We look forward to hearing from you soon!


  1. metamind.io
  2. trailhead.salesforce.com/en/projects/predictive_vision_apex
  3. github.com/rajdeepd/einstein-go-apis
  4. developer.salesforce.com/blogs/developer-relations/2017/05/using-einstein-vision-within-golang.html
  5. developer.salesforce.com/blogs/developer-relations/2017/04/using-einstein-vision-on-Heroku-or-mobile.html