惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

量子位
博客园_首页
Google DeepMind News
Google DeepMind News
博客园 - Franky
The GitHub Blog
The GitHub Blog
GbyAI
GbyAI
有赞技术团队
有赞技术团队
Microsoft Azure Blog
Microsoft Azure Blog
G
Google Developers Blog
Recent Announcements
Recent Announcements
A
About on SuperTechFans
博客园 - 【当耐特】
博客园 - 三生石上(FineUI控件)
酷 壳 – CoolShell
酷 壳 – CoolShell
美团技术团队
罗磊的独立博客
IT之家
IT之家
博客园 - 聂微东
Stack Overflow Blog
Stack Overflow Blog
Jina AI
Jina AI
腾讯CDC
P
Proofpoint News Feed
Hugging Face - Blog
Hugging Face - Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Building Shruthi Bandhu: How We Engineered an AI Gesture ...
SHAIK TAUFEE · 2026-05-15 · via DEV Community

SHAIK TAUFEEQ AHMAD

Building Shruthi Bandhu: How We Engineered an AI Gesture Tool for the Deaf-Mute Community (And Won the Vishwakarma Awards)

Some wins take time. Over the past year, I’ve walked out of innovation halls with more lessons than trophies. Every post I made was about participation, never victory. Each time, I clapped for others while swallowing the frustration of my own near-misses.

But building Shruthi Bandhu was different.

At IIT Indore, our team won 1st Prize in the HealTech Category at the Vishwakarma Awards 2025 for our AI-powered gesture communication tool. Hosted by the Maker Bhavan Foundation, the competition brought together over 3,600 STEM students from India and SAARC nations. After nine months of prototyping and mentoring, we made it from the top 1,000+ teams down to the final 12—and ultimately took home the win.

But this post isn’t just about the trophy. It’s about the six months of prototyping, the roadblocks we hit, and the engineering decisions we made to build a platform that bridges the communication gap for the deaf and mute community.

The Bottleneck: The Data Drought
When we set out to build an AI that could translate Indian Sign Language (ISL), we hit a massive wall almost immediately: the unavailability of a robust ISL dataset.

You can't train a reliable model without quality data. Since off-the-shelf datasets for ISL were either non-existent or heavily fragmented, we realized we couldn't rely on open-source repositories. We had to build it ourselves.

We didn't just scrape the web; my teammates and I actually sat down and learned Indian Sign Language. We then recorded and manually curated a custom dataset of over 1,000+ videos. It was a tedious, brute-force approach, but it gave us the clean, high-quality foundational data our models desperately needed.

The Architecture: Two Perspectives for Real-World Use
Sign language translation isn't a one-size-fits-all problem. How a user interacts with the world daily is very different from how they interact in a digital workspace. To solve this, we engineered two distinct approaches:

  1. Egocentric View (Daily Communication): We designed this for a spectacles/smart-glasses point-of-view. This allows for real-time translation as the user navigates their physical environment, capturing gestures from a first-person perspective.

  2. Exocentric View (Digital Workspaces): We optimized this for standard laptop webcams. This approach is specifically tailored for virtual meetings and conferences, capturing the user from a standard front-facing angle to ensure accessibility in professional environments.

**
 **
As engineers, it is dangerously easy to build solutions in a vacuum, assuming we know what the user wants. We knew early on that if Shruthi Bandhu was going to be truly accessible, we couldn't just guess at the community's needs from behind our laptops.

We stepped out of the lab and conducted extensive field visits at local deaf and mute schools and specialized clinics. We sat down with educators, clinicians, and the students themselves to observe their daily friction points and understand the nuances of how they communicate.

This wasn't just research; it was strict product validation. We aligned our engineering goals with their real-world needs. By the end of our prototyping phase, this user-centric approach allowed us to secure formal Letters of Intent (LOIs) from several of these institutions, proving that we weren't just building a cool project—we were building a product they genuinely wanted to deploy.

The Village Behind the Build
Seeing hardware-first and assistive tech innovation valued at this scale was validating. Receiving this award in the presence of industry leaders like Hemant Kanakia, Prof. Suhas Joshi (Director, IIT Indore), and Gautam Khanna reminded us that accessibility deserves serious engineering attention.

You don't build something like this alone. A massive thank you to:

My incredible co-founders and teammates: Shivaraj Gollapally, Varun Chiguru, and Subbarayudu Bolisetty. We solved technical bugs, logistical nightmares, and motivational slumps together.

This win isn’t a finish line—it’s a starting point. Competitions end on a stage, but impact begins in the real world.

If you are working in assistive tech, computer vision, or multimodal AI, I’d love to connect. Have you ever had to brute-force a dataset from scratch? Let me know in the comments!