Research Paper Published | React Native | Flask | Whisper STT | Voice Biometrics | Accessibility Technology
Speech-Driven Secure Banking System with Voice Biometrics is an intelligent voice-enabled payment assistant designed to improve accessibility and security in digital payment systems.
The application enables users to perform payment-related operations using voice interaction and biometric voice authentication. The project focuses on providing a secure, accessible, and user-friendly payment experience for elderly and physically challenged individuals.
This project combines Mobile Application Development, Speech Recognition, Voice Biometrics, and Backend Services into a single integrated solution.
Many elderly and physically challenged individuals face difficulties while using traditional digital payment applications due to complex user interfaces, small touch targets, and dependence on manual interaction.
The objective of this project is to simplify digital transactions through speech-driven interaction and voice biometric authentication, enabling users to perform payment operations independently and securely.
- Develop a speech-driven payment system.
- Improve accessibility for elderly and physically challenged users.
- Enable voice-based interaction for payment services.
- Implement voice biometric authentication.
- Reduce dependency on traditional touch-based interfaces.
- Demonstrate a secure and accessible payment workflow.
- Voice-guided application flow
- Hands-free interaction
- Accessibility-focused design
- Voice biometric verification
- User authentication through speaker recognition
- Secure access workflow
- Contact selection
- Payment workflow simulation
- Secure transaction confirmation
- Transaction history
- Balance inquiry
- User profile management
- Speech-to-Text conversion using Whisper
- MFCC-based voice feature extraction
- Speaker verification and authentication
- React Native
- Expo
- React Navigation
- Python
- Flask
- Flask-CORS
- OpenAI Whisper
- MFCC (Mel-Frequency Cepstral Coefficients)
- Speaker Verification
- Cosine Similarity
- SQLite
- Visual Studio Code
- Git
- GitHub
User Voice Input
↓
Speech Recognition (Whisper)
↓
Voice Biometric Verification
↓
Authentication Validation
↓
Payment Processing
↓
Database Storage
↓
Transaction History & User Services
User launches the application.
Voice guidance announces available services.
User selects a contact through voice interaction.
Speech is converted into text using Whisper Speech Recognition.
Voice biometrics verifies the registered user.
Payment request is processed.
Transaction details are stored in the database.
User can access transaction history and balance information.
Demo Video Link:
(Add YouTube or Google Drive Link Here)
This project is associated with the published research paper:
A Voice Biometric UPI Transaction System for Visually Impaired Users Using Mel Frequency Cepstral Coefficients and Cosine Similarity
Authors: Athyam Bindu Poornima et al.
Publication: International Journal of Science & Engineering Development Research (IJSDR)
Paper Link: https://ijsdr.org/papers/IJSDR2604245.pdf
- Voice Biometric Authentication
- Speaker Verification
- User Validation Workflow
- Secure Transaction Flow
- Authentication-Based Access Control
- Prototype implementation
- No direct NPCI integration
- Limited real-world user testing
- Voice replay protection not implemented
- Device binding not implemented
- Production-level fraud detection not implemented
- Voice Liveness Detection
- Device Binding
- Fingerprint Authentication
- Fraud Detection Mechanisms
- Multilingual Support
- Official UPI Integration
- Enhanced Accessibility Features
- Advanced Voice Security Mechanisms
Version: 1.0 Prototype
This project demonstrates the feasibility of combining Speech Recognition and Voice Biometrics to create secure, accessible, and user-friendly digital payment systems.
PaymentApplication/
├── backend/
├── assets/
├── components/
├── data/
├── utils/
├── screenshots/
├── App.tsx
├── package.json
└── README.md
Athyam Bindu Poornima
B.Tech – Data Analytics
Bharath Institute of Higher Education and Research, Chennai
This project is developed for academic, research, and educational purposes.