Prototype · Multilingual dispatch across IndiaWhen every second counts,
When every second counts,
no caller is left on hold.
RelayOne answers emergency calls in the caller's language, structures the incident, locates it on a map, and hands the dispatcher one screen to act on. All in under two seconds.
relayone / operations · hyderabad-fire-2041
Live · 12 active callsDispatcher A. ReddyShift 02:41:07
Hyderabad
Chennai
Kolkata
Lucknow
Priority
Critical High Medium Low
Incident
Factory fire, workers trapped
Location
Balanagar Industrial Estate, Hyderabad
Caller
Telugu, translated to English
AI confidence
94%
Dispatch Timeline
INC-2041- 00:00Call answered in TeluguVoice captured, streaming ASR started
- 00:00Language detectedTelugu (TE), confidence 0.98
- 00:01Incident classifiedStructure fire, victims trapped upstairs
- 00:01Location resolvedBalanagar Industrial Estate, Hyderabad
- 00:02Brief handed to dispatcherOne-screen brief, action recommended
- 00:04Units acknowledged2 fire tenders, 1 ALS, 1 police unit
Resource Status
4 assigned- Fire Tender FT-04ETA 3m
- Fire Tender FT-07ETA 4m
- ALS Ambulance A-12ETA 5m
- Police Unit P-21On scene
1
On scene
3
En route
8
Available
The Response Pipeline
One continuous flow, from first ring to first responder.
Nine stages, one system. Each stage feeds the next in real time.
- 01Emergency CallCaller dials, no app required.
- 02AI AnswersFirst response in under a second.
- 03Speech RecognitionStreaming ASR with word timing.
- 04Language Detection13+ Indian languages, auto-detected.
- 05UnderstandingClaude reasons over the caller's story.
- 06TranslationDispatcher reads English in real time.
- 07LocationAddress, hazards, nearest units.
- 08DispatcherOne brief, one screen, one decision.
- 09Units DispatchedFire, police, medical, en route.
End-to-end latency target< 2 seconds
AI stage Human touchpoint
System Architecture
A three-stage engine that turns a panicked voice into a dispatch order.
Input, processing, output. Every module has a job and a defined signal it hands to the next stage.
Stage 01
Input
- CitizenThe person on the line, often under acute stress.Outputs:Raw voice stream
- VoiceContinuous audio capture with word-level timing.Outputs:Timed audio frames
- LanguageDetects the language before transcription completes.Outputs:Language code + confidence
- LocationCell signal and caller phrasing seed geolocation.Outputs:Approximate coordinates
Stage 02
AI Processing
- Speech RecognitionStreaming ASR transcribes the caller in real time.Outputs:Native-language transcript
- TranslationTwo-way translation so the dispatcher reads English.Outputs:English transcript
- LLM ReasoningClaude reads the story and asks the right follow-ups.Outputs:Structured incident record
- ClassificationMaps the incident to a response taxonomy.Outputs:Type, sub-type, tags
- Hazard DetectionCross-checks the scene against chemical, fire, flood layers.Outputs:Hazard list + exclusion zones
- Priority ScoringSeverity, vulnerability, and elapsed time set the score.Outputs:Priority 1 to 4
Stage 03
Output
- Dispatcher DashboardOne screen with brief, map, recommended units.Outputs:Actionable brief
- PoliceNearest patrol units notified with route and role.Outputs:Patrol assignment
- FireTenders and hazmat crews staged with scene notes.Outputs:Fire response order
- MedicalAmbulances routed with victim count and injuries.Outputs:Medical response order
↓ passes
↓ passes
↓ passes
Claude
Reasoning
Deepgram
Streaming ASR
FastAPI
Realtime services
Redis
Live state
Mapbox
Geospatial
WebSockets
Sub-second updates
Next.js
Dispatch console
LoopDownstream signals feed back into the LLM's next turn.
HumanThe dispatcher confirms every action. AI never dispatches alone.
Why It Matters
Built for the scale of a country in motion.
22
Official languages spoken across India
40M+
Emergency calls placed in India each year
8 min
Average hold time during a monsoon surge
< 2s
AI response time
13+
Languages supported
90%
Triage accuracy
100%
Address extraction
24/7
Always available
An AI & Robotics Hackathon prototype of India's next-generation emergency command platform.
