Resources
Case Studies

Tally: The Store Master

The robot helping stores automate tedious tasks

By
Fawzi Ammache
March 25, 2022

Inventory tracking is… annoying

Every physical store has to keep track of its inventory.

While their point of sale (POS) systems can give them a good idea of how many lightbulbs or Doritos bags they still have in stock, it’s never perfectly reliable.

Manual counts have to be made to ensure consistency between the inventory system and what the store actually has. The frequency of these checks varies and can be done on a monthly, quarterly, or yearly basis depending on the store.

These cyclical checks may still not be enough. I’ve been in multiple situations where I checked the in-store stock for something online only to find myself staring at an empty shelf when I got there.

Maintaining accurate information about their inventory helps stores in many ways:

  • Ensuring timely stock replenishment: knowing what’s still in stock, running low, or completely out helps the store make purchase orders in a more timely manner.
  • Ensuring pricing and promotion consistency: making sure that prices and discounts are displayed correctly to avoid any customer confusion and potential loss of revenue.
  • Tracking misplaced or stolen items: while the POS system can track what was sold, it’s harder to track what items have been misplaced or stolen.
  • Reporting inventory for tax purposes: tracking inventory is one of the important items on a company’s balance sheet. And we all want to stay on the (insert your country’s revenue agency)’s good side.

Meet Tally

Simbe In Store

Simbe Robotics is combining robotics and computer vision to help make retailers’ lives easier.

They created Tally, an autonomous robot that can roam the aisles of a store, scan the shelves, and give store employees and managers valuable insights.

  • More frequent checks: Tally can conduct 3 store audits per day and sends a report to the store manager or compliance lead. According to Simbe, Tally captures 15,000 to 30,000 products per hour with 99% accuracy.
  • No supervision: once the store is mapped and the audit times are programmed, Tally can leave and return to its charging station on its own. If anything goes wrong, Simbe’s team can fix software issues remotely or send one of their engineers for physical repairs.

What can Tally do?

#1: Detecting out-of-stock items

Tally can detect up to 10x more out-of-stock items than manual checks, according to Simbe. In the image below, Tally’s scans highlight empty areas on the shelf in pink (missing facings) and which items are starting to run low in blue (out on shelf).

(Source: Simbe Robotics)

#2: Ensuring pricing and promotion consistency

Tally is equipped with sensors and cameras that can scan different types of price tags and barcodes to ensure the right prices and promotions are displayed to customers. Store employees are alerted if there are any discrepancies.

(Source: Simbe Robotics)

#3: Detect misplaced or missing inventory

If an item has been misplaced, Tally can alert store employees to put it back on the right shelf. It can also integrate with a store’s POS to detect if any items have been stolen.

People who leave items (esp. food) in the wrong aisle. : r/mildlyinfuriating
(Source: Reddit, r/mildlyinfuriating)

#4: Shelf display insights

Stores create “planograms” to plan and optimize how they’re going to display their products on shelves. But it’s hard to track how different configurations of product displays affect sales.

Think of Tally as a tool for physical store analytics: it can highlight which shelves sell the most through store maps with hotspots of popular areas, and even heatmaps for individual shelves.

These insights can help stores measure the impact of product placements and even A/B test different layouts to track the impact on sales.

Enjoying this article? Subscribe for free to get the latest one in your inbox every Friday.

Subscribe

The future of Tally: reducing food waste?

I came across a patent that Simbe was recently granted.

The patent, titled “Method for tracking and characterizing perishable goods in a store”, was issued on December 14, 2021.

The patent covers functionality that will allow Tally (or another Simbe product) to scan and detect characteristics of perishable goods like fruits and vegetables. More specifically, it can detect levels of ripeness, bruising, and spoilage.

Theoretically, here’s what would happen if Tally is scanning bananas:

  1. Tally scans the bananas
  2. An image of the bananas is uploaded to a database
  3. An algorithm analyzes the image and classifies the items as bananas
  4. Once items in the image have been classified, another algorithm assigns the levels of ripeness, bruising, or spoilage. The algorithm would have been trained on thousands of images of bananas to deduce those characteristics.
  5. One of two things happens next:
    • The banana falls within the target quality range → no action is needed
    • The banana falls outside the target quality range (too ripe) → needs replacement

If you prefer a visual, here’s the main figure from the patent application:

If you look at this specific box in the diagram, you’ll notice that the system assigns:

  • Ripeness percentage
  • Colour
  • Number of days to ripe
  • Damage

Final thoughts


This feature creates an opportunity for grocery stores to anticipate and reduce food waste.

For example, if the store still has lots of bananas in stock that will be spoiled within days, they can offer promotions and discounts to customers. The stores may not profit from it, but customers get a great price and everyone can contribute to reducing food waste. According to the UN, 50% of fruits and vegetables produced globally are wasted each year (UNEP).

I’m excited to see how Simbe Robotics puts this patent into practice. I’ll make sure to provide any updates in future newsletters.

Deep dive

If you enjoyed today’s story, I’ve compiled some additional links to satisfy your curiosity:

Fawzi Ammache
Founder, Year 2049

Become an AI Pro

An email a week with the AI knowledge you seek.

Never miss Year 2049's latest resources, courses, and more by subscribing to our weekly newsletter.

Unsubscribe anytime. By registering you agree to Substack's Terms of Service, Privacy Policy, and Information Collection Notice
Thank you! Your submission has been received!
Oops! Something went wrong. Please try again.