# Sanjeevini.me - Healthcare App - Open Source - Audio AI

**URL:** https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142
**Category:** Rainmatter Health
**Created:** [November 18, 2024, 9:58pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142 "2024-11-18T21:58:04Z")
**Posts on this page:** 15
**Page:** 1

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [November 18, 2024, 9:58pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/1 "2024-11-18T21:58:04Z")

</div>

Started building an Healthcare app with Audio based AI.  
Convert the conversation between Doctor and Patient and generate Reports.

Idea is to Integrate with Ayushman Bharat Digital Mission/ Aadhar Health ID.  
Build via Open Source, to build features collaboratively.

web : [https://sanjeevini.me](https://sanjeevini.me)  
source - [GitHub - slabstech/sanjeevini\_frontend: UX for Sanjeevini.me - AI Health App](https://github.com/slabstech/sanjeevini_frontend)

---

<div class="post-metadata">

### Author: ![Vinny](https://discuss.rainmatter.com/user_avatar/discuss.rainmatter.com/vinny/32/1020_2.png) [@Vinny](https://discuss.rainmatter.com/u/Vinny)
#### Post date: [November 19, 2024, 6:41am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/2 "2024-11-19T06:41:22Z")

</div>

This is very cool. We have this healthcare enablement app on the playstore. It’s called Ensocure. I wonder if we could work together.

---

<div class="post-metadata">

### Author: ![Vinod](https://discuss.rainmatter.com/user_avatar/discuss.rainmatter.com/vinod/32/1025_2.png) [@Vinod](https://discuss.rainmatter.com/u/Vinod)
#### Post date: [November 27, 2024, 7:22am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/3 "2024-11-27T07:22:36Z")

</div>

That’s amazing! As a non-tech founder, we’re struggling to find the right CTO co-founder to help us build a Food Navigator. Do you have any ideas or suggestions on how to approach the tech side of things? Also, how much did your app cost to develop?

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [November 29, 2024, 10:26pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/4 "2024-11-29T22:26:39Z")

</div>

I am the sole-developer building the prototype to production app.  
Also i use Code assistants to integrate work and refactor my code.

I have been attending hackathon’s and talking to the dev’s to collaborate.  
That would one of the ways to find collaboration.

For the prototype i am using free resources.  
Frontend - React hosted on @github Pages Backend - Django hosted on @huggingface spaces, AI Inference - MistralAI and Nvidia NIM Free API Tier .

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [November 29, 2024, 10:42pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/5 "2024-11-29T22:42:54Z")

</div>

Yes, We can collaborate for the project, I would love to get feedback for the base feature.

Idea is to build like GitLab/ OpenCore model, its a work in progress and still many things to do.  
I am building it full-time now, a version should be ready by Mid-december 2024.

---

<div class="post-metadata">

### Author: ![Vinod](https://discuss.rainmatter.com/user_avatar/discuss.rainmatter.com/vinod/32/1025_2.png) [@Vinod](https://discuss.rainmatter.com/u/Vinod)
#### Post date: [November 30, 2024, 6:36am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/6 "2024-11-30T06:36:49Z")

</div>

> [@Vinod](#):
>
> That’s amazing! As a non-tech founder, we’re struggling to find the right CTO co-founder to help us build a Food Navigator. Do you have any ideas or suggestions on how to approach the tech side of things? Also, how much did your app cost to develop?

That’s a solid approach, @gaganyatri . Hackathons are indeed a great way to connect with passionate developers. Since you’re leveraging free resources for the prototype, that’s incredibly resourceful. Can you share more details on how you’re managing the integration of these tools?

Also, what would you suggest for a non-tech founder like me to get started with something similar, even if it’s just understanding the process better?

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [November 30, 2024, 7:56pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/7 "2024-11-30T19:56:27Z")

</div>

> <https://github.com/slabstech/gaganyatri.in/blob/main/docs/deployment.md>

is an incomplete version of how my project is integrated.

I will update it soon, with some changes i have introduced.  
You can use ChatGpt to expand the document and provide a roadmap to understand.

I also use Perplexity.ai a lot for adding new features and solving problems.

My dev setup is  
VsCode + Continue Dev Plugin + Mistral API .

Discord for the project, though its not actively maintained.  
[https://discord.com/invite/h8ygUwvw](https://discord.com/invite/h8ygUwvw)  
Also my X account at [x.com/gaganyatri](http://x.com/gaganyatri) usually has some details.

Its a daily grind, try to experiment with small changes.  
I dont copy anything more than 10-20 lines, it becomes impossible later to debug.

---

<div class="post-metadata">

### Author: ![Vinod](https://discuss.rainmatter.com/user_avatar/discuss.rainmatter.com/vinod/32/1025_2.png) [@Vinod](https://discuss.rainmatter.com/u/Vinod)
#### Post date: [December 1, 2024, 10:51am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/8 "2024-12-01T10:51:32Z")

</div>

Thank you

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [December 19, 2024, 12:52pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/9 "2024-12-19T12:52:39Z")

</div>

version 0.1 - Pitch document.

Collected all ideas and progress made over the last few months,  
Will keep updating each month.

[Drive Link](https://docs.google.com/document/d/1MLLlIjJc__GsFyU9xFDTlmfUwD_ecNwR/edit)

PDF below .  
[sanjeevini\_pitch.docx.pdf](https://discuss.rainmatter.com/uploads/short-url/j3YQUoO5CngLgT08XxdvBobuGA6.pdf) (65.3 KB)

---

<div class="post-metadata">

### Author: ![Vinod](https://discuss.rainmatter.com/user_avatar/discuss.rainmatter.com/vinod/32/1025_2.png) [@Vinod](https://discuss.rainmatter.com/u/Vinod)
#### Post date: [December 20, 2024, 8:48am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/10 "2024-12-20T08:48:43Z")

</div>

Thanks for the update

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [February 19, 2025, 9:51am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/11 "2025-02-19T09:51:05Z")

</div>

Benchmark for Medical Agents -

New healthcare support solutions using GenAI methods, could use this to validate their systems

MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents  
arxiv - [[2501.14654] MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents](https://arxiv.org/abs/2501.14654)  
source - [GitHub - stanfordmlgroup/MedAgentBench: MedAgentBench: Dataset for Benchmarking LLMs as Agents in Medical Applications](https://github.com/stanfordmlgroup/MedAgentBench)

For [Sanjeevini.me](http://Sanjeevini.me) - we have decide to Use Cloud hosting for demo and version.  
Since the compute capacity of Jetson Nano was not sufficient for real-time traffic. Jetson Xavier NX is another option, though expensive. Without incurring additional development cost for on -device setups,  
We will target large audience with Cloud API integration  
Once smaller models are available, we will plugin our optimised code to deliver on-device solutions.

---

<div class="post-metadata">

### Author: ![Vinod](https://discuss.rainmatter.com/user_avatar/discuss.rainmatter.com/vinod/32/1025_2.png) [@Vinod](https://discuss.rainmatter.com/u/Vinod)
#### Post date: [February 20, 2025, 11:36am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/12 "2025-02-20T11:36:27Z")

</div>

Thanks for the Update

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [February 23, 2025, 11:28pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/13 "2025-02-23T23:28:43Z")

</div>

We have contact !!!

After months of wrangling, finally got ASR(Automatic Speech Recognition) for kannada working .

Now we have - End to End Speech for Kannada.

No more walled Gardens !!!

Build your own Alexa/Siri/Google voice commands systems and speak with native languages.

All systems running locally with GPU and no continuous Internet required.

- End to End Flow

- Source

Business case :

- [Sanjeevini.me](http://Sanjeevini.me) : Medical Transcription Agent - is now unlocked.

 ![mistral_large_kannada](https://discuss.rainmatter.com/uploads/default/original/2X/1/128e6d08444095f8c2e76ec48a533e76fc848cc3.png)  
 ![Screenshot from 2025-02-23 23-57-16](https://discuss.rainmatter.com/uploads/default/original/2X/c/c4799f6a46b96fa8bbe90c7986190567dbf715e7.png)

---

<div class="post-metadata">

### Author: ![Ezhil](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/e/5f8ce5/32.png) [@Ezhil](https://discuss.rainmatter.com/u/Ezhil)
#### Post date: [March 4, 2025, 5:37am UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/14 "2025-03-04T05:37:57Z")

</div>

This is awesome @gaganyatri

---

<div class="post-metadata">

### Author: ![gaganyatri](https://discuss.rainmatter.com/letter_avatar_proxy/v4/letter/g/dfb087/32.png) [@gaganyatri](https://discuss.rainmatter.com/u/gaganyatri)
#### Post date: [March 9, 2025, 12:39pm UTC](https://discuss.rainmatter.com/t/sanjeevini-me-healthcare-app-open-source-audio-ai/1142/15 "2025-03-09T12:39:54Z")

</div>

Medical Transcription has to be accurate and verifiable by 3rd party audio,

We have now made the underlying technology Open Source and accessible to everyone.

[Sanjeevini.me](http://Sanjeevini.me) will be built on top of this stack.

Dhwani - Voice AI - Android app now available in Early access program.

DM, me your email-id connected to Google Play store to get access to the App.

 ![dhwani-6](https://discuss.rainmatter.com/uploads/default/original/2X/7/7bf7b77eea71434541fef8ca9a4a684e1a0f8d44.jpeg)  
 ![dhwani-7](https://discuss.rainmatter.com/uploads/default/original/2X/d/d5694290aa8eebbe1d85695e707b45a687e90c22.jpeg)  
 ![dhwani-5](https://discuss.rainmatter.com/uploads/default/original/2X/e/ed49d10ada5bd18688131c2a192c2a4214abd0f9.jpeg)

Source -  
Android - [GitHub - dwani-ai/dwani-android](https://github.com/slabstech/dhwani-android)

Backend - [GitHub - dwani-ai/dwani-server](https://github.com/slabstech/dhwani-server)
