This is a submission for the Presage SmartSpectra SDK Challenge
What I Built
PitchPulse is a private desktop rehearsal studio for high-pressure speaking.
Most presentation tools provide an arbitrary score after the performance is over.
PitchPulse focuses on a more actionable question:
When pressure rises at the same moment, can I recover more steadily on the next take?
During Take 1, the speaker marks a difficult moment—such as a pricing slide,
audience objection, or forgotten transition—by pressing Spacebar. PitchPulse
uses live signals from the Presage SmartSpectra SDK, including pulse, breathing,
and camera-facing gaze estimates, to visualize what happens around that moment.
Before Take 2, the speaker uses a brief breathing pacer. During the second
rehearsal, the recorded pulse timeline from the first take becomes a translucent
Ghost Take reference curve, allowing the speaker to compare both recovery
patterns side by side in real time.
PitchPulse does not measure confidence, diagnose anxiety, or judge performance.
It helps speakers privately rehearse their own response to pressure.
┌────────────────────────────────────────────────────────────────────────┐ │ TAKE 1 │ │ Speaker delivers opening or tackles a difficult objection. │ │ Presses [⚡ Spacebar] at the hard moment. │ │ SmartSpectra tracks cardiac and respiratory response. │ │ PitchPulse estimates recovery latency back to baseline threshold. │ └───────────────────────────────────┬────────────────────────────────────┘ │ [Brief Calming Pacer] │ ┌───────────────────────────────────▼────────────────────────────────────┐ │ TAKE 2: GHOST TAKE MODE │ │ Speaker re-pitches with Take 1's recorded pulse timeline as a ghost. │ │ Translucent violet Ghost Wave renders behind the live pulse wave. │ │ Speaker delivers the same section with steady pacing. │ │ Compares live pulse pattern against the previous run in real time. │ └───────────────────────────────────┬────────────────────────────────────┘ │ [Comparative Review] Side-by-side inspection of both recovery patterns Demo
Watch the complete, unedited walkthrough showing live webcam acquisition via the Presage SmartSpectra SDK, baseline calibration, pressure moment marking, speech-gated breathing, and real-time Ghost Take comparative rehearsal:
Direct YouTube Link: https://www.youtube.com/watch?v=-qHHrUmUZfs
Code
PitchPulse is open source under the Apache 2.0 License:
🔗 GitHub Repository: https://github.com/JaniDhruv/PitchPulse
Quick Setup
# 1. Clone git clone https://github.com/JaniDhruv/PitchPulse.git cd PitchPulse # 2. Install dependencies npm install # 3. Configure your Presage SmartSpectra API Key cp .env.example .env # Add your SMARTSPECTRA_API_KEY to .env (or paste it into Settings in the app) # 4. Launch in development mode npm start How It Responds to Human Signals
PitchPulse integrates the official @smartspectra/node-sdk (v3.4.0) into an Electron 45 + React 19 + Tailwind CSS 4 + Vite 8 desktop application.
┌─────────────────────┐ ┌──────────────────────────┐ ┌──────────────────────────────┐ │ Standard Webcam │ │ Electron Main Process │ │ React 19 Renderer (60 FPS) │ │ 720p @ 30 fps │ │ (Native C++ FFI/koffi) │ │ │ │ │ │ ┌──────────────────────┐│ │ ┌────────────────────────┐ │ │ getUserMedia ─────┼─────┼─→│ SmartSpectra SDK ││ │ │ PulseCanvas (HTML5) │ │ │ │ │ └──────────┬───────────┘│ │ │ BreathingCanvas (Gated)│ │ │ │ │ ┌──────────▼───────────┐│ │ │ EyeContactMeter (Gaze) │ │ │ │ │ │ bindSmartSpectraIpc ││ │ │ Ghost Take Overlay │ │ │ │ │ └──────────┬───────────┘│ │ │ Flight Recorder Scrubber│ │ │ │ └─────────────┼────────────┘ │ └────────────────────────┘ │ │ │ │ MessagePort │ ▲ │ │ │ ┌─────────────▼────────────┐ │ ┌───────────┴────────────┐ │ │ │ │ Preload Context Bridge ├─────┼─→│ decodeMetrics │ │ │ │ │(MessagePort frame bridge)│ │ │ (Protobuf Stream) │ │ │ │ └──────────────────────────┘ │ └────────────────────────┘ │ └─────────────────────┘ └──────────────────────────────┘ 1. Live Physiological Signals Used
- Cardio signals (Pulse Rate and HRV):
- Received from the SmartSpectra native runtime and decoded in the Electron renderer.
- Rendered onto HTML5 canvas visualizations using mutable buffers for smooth real-time updates.
- Used to estimate recovery latency: the elapsed time until pulse returns within the app's baseline threshold.
- Breathing (Respiratory Rate and Waveform):
- Monitored through optical rPPG.
- When speech is detected, breathing updates pause and the trace holds steady to avoid interpreting mouth and jaw motion as respiratory changes.
- This keeps the breathing visualization honest during active speaking.
- Iris Gaze & Orientation Landmarks:
- Estimates camera-facing gaze alignment (
Camera-Facing Gaze Estimate). - Offers subtle, optional on-screen prompts (e.g., "Look at the camera", "Inhale through your nose") when prolonged gaze drift or breath-holding is detected.
- Estimates camera-facing gaze alignment (
2. Time-Aligned Ghost Take Engine
During Ghost Mode, Take 1's saved pulse rate samples are time-aligned against Take 2. Rather than generating a synthetic sine wave, the violet Ghost Wave replays the recorded pulse-rate timeline from the prior run, giving the speaker a consistent personal baseline to compare against.
3. Truth-to-Demo and Scientific Modesty
- No Fabricated Data: If no pressure moment is marked or no pulse rise is captured, PitchPulse shows "No measurable pressure moment captured" instead of inventing a flattering recovery metric.
- Clear Provenance: Sessions running without a live key display an amber
[⚠️ DEMO DATA — NO LIVE SENSING]watermark. If Take 1 was a demo run and Take 2 is live, Replay marks the comparison with a[Mixed Demo Comparison]tag to keep test data distinct from live measurements.
Prize Categories
🌟 Best Thoughtful Real-World Use
PitchPulse addresses a practical need for presenters, students, interview
candidates, and speakers who want to rehearse difficult moments privately.
Instead of assigning a generic confidence score, PitchPulse gives users a
repeatable process:
- identify a pressure moment;
- observe their own signals;
- reset with guided breathing; and
- rehearse the same moment again.
The experience is consent-first, self-relative, and transparent about the limits
of camera-based sensing. Camera video is not saved, sessions are stored locally,
telemetry is disabled by default, and live and simulated data are clearly
distinguished.
🎮 Most Creative or Delightful Use
The Ghost Take mechanic is inspired by racing games. Instead of racing against
another driver, the speaker rehearses against their own previous physiological
trace.
The violet reference curve makes an abstract recovery pattern easy to
understand: users can see where the previous take changed and compare it with
the current take in real time.
This turns physiological feedback from a passive dashboard into an interactive,
repeatable rehearsal challenge.
Consent and Data Handling
PitchPulse was built with a clear Responsible Sensing structure:
- Explicit Consent & Choice:
- On first launch, a dedicated Consent Screen explains how camera sensing works and outlines the educational wellness scope.
- Users must explicitly confirm agreement before entering the studio.
- Local Frame Handling & Privacy:
- Camera video is accessed through
getUserMediaand processed through the local Electron and SmartSpectra pipeline. - PitchPulse does not save camera video, frame buffers, or facial images to disk. Camera frames remain inside the local Electron/SmartSpectra processing pipeline rather than being uploaded as application data.
- The SmartSpectra SDK may require network access for authentication and model resources.
- Camera video is accessed through
- Telemetry Control:
- The Consent Screen includes an explicit SDK telemetry toggle.
- Telemetry is disabled by default, and PitchPulse does not intentionally enable SDK telemetry when the user leaves it disabled.
- Local Data Retention & User Control:
- Saved sessions contain only numerical time-series metrics (timestamps, pulse rate integers, gaze offsets).
- Data is stored strictly on the local filesystem (
pitchpulse_sessions/). - Users can review, export, or permanently delete any session at any time with one click.
- No Cloud AI / No Third-Party LLMs:
- Biometric signals are never sent to third-party language models or external analysis services.
- Non-Medical Educational Scope:
- PitchPulse includes an explicit disclaimer: it is an educational rehearsal tool for presentation practice and does not provide medical monitoring, clinical diagnosis, or anxiety treatment.
Thank you to DEV and Presage Technologies for organizing the Presage SmartSpectra SDK Challenge!