Benchmarking of UPI QR Code Scanning Performance Across Devices, Visibility Conditions, and QR Quality

Client Overview

Tata Neu, a super app developed by Tata Digital (a subsidiary of the Tata Group), aims to be a one-stop shop for various products and services by integrating offerings from different Tata and other brands onto a single platform.

Problem Statement

Tata Digital started its own UPI service called Tata Neu UPI to strengthen its position in the digital payments industry, but the crowded Indian UPI market poses a challenge for Tata Neu to gain significant market share. To improve their UPI services, they plan to benchmark key events like scanning time and payment speed against popular competitors. Tata Neu collaborated with Auriga IT for our proven track record in app benchmarking, including experience with industry leaders like Amazon and Meta (formerly Facebook).

• User Adaptability- Since Tata Neu was a new player in the market, it was essential to compare its QR code recognition capabilities – a crucial aspect of UPI payments – against those of established competitors.
• Identify Areas for Improvement-  Project aimed to test QR code scanning capabilities in real-life scenarios, considering variations in user devices, camera capabilities, and other factors, to pinpoint potential areas for improvement in the scanning experience.
• Scanning Adaptability- There was a need to test the app’s ability to successfully scan and process QR codes under various conditions based on different devices.

Solutions

To address Tata Neu’s UPI market challenges and enhance their services,  Auriga devised a comprehensive benchmarking strategy. This included rigorous testing of QR code recognition capabilities under diverse real-world conditions, assessing user adaptability against established competitors like Paytm, Phonepe, Cred, Gpay.

• Compared Device Capabilities – To account for the diverse capabilities of user devices, we conducted benchmark tests on QR code scanning performance across various UPI apps. These tests were performed in a controlled lab environment using a range of high-end, medium-end, and low-end devices, simulating real-world conditions.

• Scanning Adaptability- We conducted  the study in our testing lab, adjusting distance, angle,lighting condition and QR code quality to mimic real-life conditions typical users might encounter. This allowed us to benchmark Tata Neu’s performance against popular apps, identifying specific areas for improvement.

• Detailed Dashboard/Report- Through comprehensive real-life tests, we developed a dashboard and detailed report benchmarking Tata Neu against popular UPI apps. This data analysis highlighted strengths and areas for improvement, aiding Tata Neu in enhancing its app to better compete in the market.

Following events were captured during the study 

• Scanning Journey Begins
• Scanner Page Loaded
• Camera is Functional
• Scanning is Complete
• Enter Amount Page Loaded
• Enter UPI Pin Page loaded
• Payment confirmation page

Project Outcome

• An analytical dashboard   to visualize the outcomes of the study for further decision making  .
• Identify bottlenecks and industry standards for the Tata Neu team to take initiative to enhance Product and improve User experience 
• Detailed dashboard enabled Tata Neu to intuitively sort, filter, and view benchmarking results.