notesGPT: AI-Powered Voice Notes with Transcription and Summarization

Introduction

notesGPT is an open-source application designed to revolutionize how you manage voice notes. It provides a seamless experience for recording audio, which is then automatically transcribed, summarized, and processed to generate actionable tasks using advanced AI models. This project showcases a powerful integration of modern web technologies and large language models to transform raw voice input into structured, useful information.

Installation

To deploy your own instance of notesGPT, follow these steps:

• Clone the repository:

  git clone https://github.com/Nutlope/notesGPT.git
  cd notesGPT
  

• Install dependencies:

  npm install
  

• Run the development server:

  npm run dev
  

  This will prompt you to log into Convex and create a project.

• Set up Clerk for authentication:

  • Create a Clerk account.
  • Copy your CLERK_SECRET_KEY and NEXT_PUBLIC_CLERK_PUBLISHABLE_KEY API keys into a .env.local file.
  • Follow the steps here to obtain your Clerk Issuer URL (e.g., https://some-animal-123.clerk.accounts.dev).
  • Add the CLERK_ISSUER_URL to your Convex Environment Variables.

• Configure Together.ai for AI services:

  • Create a Together account to get your API key.
  • Save your TOGETHER_API_KEY in your Convex Environment Variables.

After completing these steps, your frontend and backend should be running, allowing you to log in and start recording voice notes.

Usage Examples

Using notesGPT is straightforward. Once logged in, you can simply record a voice note. The application then automatically processes this audio, transcribing it into text. Following transcription, an AI model generates a concise summary of your note and identifies any potential action items or tasks mentioned. This allows you to quickly review the key points and manage your to-do list without manually sifting through long recordings.

Why Use It

notesGPT offers a powerful solution for anyone who frequently takes notes on the go or prefers speaking over typing. Its AI-driven features save significant time by automating transcription and summarization, ensuring you never miss an important detail or task. The ability to instantly transform spoken thoughts into actionable items makes it an invaluable tool for productivity, idea generation, and task management. Furthermore, being open-source, it provides transparency and flexibility for developers to customize and extend its capabilities.

Links

• GitHub Repository
• Live Demo