The office kitchen as a biometric service
Co-creating the shopping experiences of tomorrow
TINE Group's Technology Lab exists to experiment, learn and spread what they’ve learned. We helped them explore the shopping experience of the future.
TINE is a company in the midst of digital transformation. Its technology lab strives to keep the latest technologies on its radar and lead the way to a culture ready for change. Experimentation is the best way to both learn and uncover new business potential, so TINE collaborated with Futurice and DNB to explore how to create tomorrow’s shopping experience.
What we did
We began by bringing together a core team of service designers and developers from TINEs Technology Lab, Futurice and DNB New Tech Lab. The first goal was to launch a facial recognition payment service that would cut out the need to reach for your wallet or other payment methods, making queues a thing of the past. In just six weeks we created Blunk, the first facial recognition payment service in Norway. The solution combines a range of technologies, including:
- Face detection and facial recognition algorithms
- Secure and anonymized face template storage
- Pre-processing and registration functionalities
- A mobile web application for registration
- An in-store tablet application for payments
- A cloud-based backend for integrating the services
Soon after a successful pilot at Cafè Heimatt in Oslo, we realized this was just the beginning.
Enter TINE AI Refrigerator, Norway’s first no-checkout shopping experience - a refrigerator with computer vision that recognizes the customer and the products stocked. The AI Refrigerator, an MVP prototype executed in just three months, takes the customer through the entire purchase process without a single push of a button. It’s as simple as reaching for yogurt in your fridge at home. The Blunk facial recognition payment technology recognizes the customer, unlocks the refrigerator, and processes the payment, while a neural network in Azure (with a YOLO model in backup) monitors stock levels in the fridge at any given time. Talk about shopping made easy!
Why it matters
The TINE Technology Lab exists to experiment, learn and spread what they’ve learned. TINE has identified ambassadors who are closely linked to the tech lab and capable of giving valuable feedback and guiding the experiments to provide business value. Demos are held regularly during the course of an experiment, and finally, a sharable lab report is written.
The Blunk Face Payment solution offers endless opportunities for automated cash registers, retail concepts and innovative business models. In making the payment process as fast and effortless as possible, the authentication, performed in mere seconds, enhances the shopping flow like nothing else.
The AI Refrigerator takes things even further as shopping means a customer only needs to take a product off the shelf. For Norwegian businesses like TINE and DNB it’s important to be at the forefront of digital experimentation so they don't have to do new things on global tech giants’ terms.
Both of these innovative services also gained a lot of interest and attention from customers and media alike.
A transformation from active product selection and in-store payment to simply accepting payment, making the buying process easier and with less friction.
Proven concepts with excellent feedback – the first in Norway.
The Blunk and AI Refrigerator make shopping more spontaneous by removing the need for payment devices, cards and cash, so all a customer needs to do is take a product off the shelf.
Greater shop safety and hygiene during crises like COVID-19.
The AI Refrigerator optimizes logistics and production by constantly monitoring stock levels.
Leading the way towards digital culture and modern ways of working at TINE.
To execute such an experimental cutting edge project, we needed a tightly knit, cross-functional and highly competent team. I am very impressed by how Futurice acted more like a partner than a consultancy. Their ability to quickly understand our needs, connect the right resources from Futurice with our internal resources, combined with an amazing “can do” attitude throughout the project was the recipe for success.”
Sven Richard Tønnessen
Head of TINEs Technology Lab
About TINE Group
TINE SA is Norway's largest producer, distributor and exporter of dairy products. Its business idea is to use pure, natural raw materials to produce delicious, healthy food through close interaction between nature, agriculture, consumers and trade. Throughout TINE’s 160-year history, the company has built the business on diligence in both technical food and production expertise across Norway and around the world.
Want to know more about this?
Pål Werdenhoff, Managing Director, Oslo
+47 907 25 404