What is PupPal: The AI Pet Companion That Turns Photos into Care

2026-08-06

What is PupPal: The AI Pet Companion That Turns Photos into Care

PupPal is an AI-powered pet check-in and care system built around a simple idea: photo = check-in, share = care. Instead of asking owners to fill in forms or maintain spreadsheets, PupPal turns an ordinary photo of your pet into a full check-in — automatically analyzed, tracked, and shared with the people who matter.

How a photo becomes a check-in

When you snap a photo of your pet, it is uploaded to an R2 bucket through a Cloudflare Worker relay. From there, a Hermes Agent takes over and runs a pipeline of specialized skills:

  • Vision analysis reads the photo and describes your pet's condition.
  • C7 anomaly detection looks for deviations from normal — a health flag that might otherwise go unnoticed until it becomes a problem.
  • Status update writes the result back into the pet's persistent state, so every check-in accumulates into a real history.

The result: a check-in record that takes seconds to create and carries far more signal than a manual log entry.

Share = care

The second half of the idea is what makes PupPal different. Every pet has a care code + PIN, a pattern borrowed from RustDesk's pairing model. Give that code to a friend or family member and they can take over care duties immediately — without creating an account, installing anything, or ever touching the social graph.

This is designed for the most common real-world scenario: you travel, your pet stays with a relative, and they need to keep the routine alive. The caregiver gets an AI-generated care handbook with everything they need to know, and while a foster care period is active, the care-monitor skill tracks your pet with more sensitive anomaly thresholds.

The architecture

PupPal runs on a three-layer stack:

Flutter App ──▶ Cloudflare Worker (R2 + Relay) ──▶ Hermes Agent (AI layer)
  • The Flutter app (iOS / Android / desktop) handles photos, care-code management, and result display. It is built LocalSend-style on a single cross-platform codebase.
  • The Cloudflare Worker is the relay and coordination layer: it stores photos in R2, manages subscriptions and AI rate limits in KV, and hosts the agent session in a Durable Object.
  • The Hermes Agent is the brain. In v2 it is driven through a native Rust → FRB → Flutter bridge, with a skill set that includes photo analysis, nightly reviews, care monitoring, handbook generation, and a daily "voice" written from the pet's first-person perspective.

Events flow through webhooks — init, photo, care-create, care-end — so every action the app performs is a first-class signal the agent can react to and remember.

Always on, even when you're away

PupPal runs scheduled reflections too: a nightly review at 21:00 that summarizes the day and calculates trends, and a morning voice at 09:00 that greets you from your pet's perspective. Between the anomaly detection, the trend calculation, and the care monitoring, the system is designed to catch health drift early — and to keep a loved one in the loop no matter where you are.

Check-in, foster care, and (coming next) adoption — that is the roadmap, and every part of it is built on the same principle: the pet is the center, the AI does the heavy lifting, and sharing care should be as easy as sharing a photo.