Passive AI Task Mining (Browser Extension): Discover and Turn Repetitive Browser Workflows into Puzzle Maps
L
Lucho
🔄 Current Situation
Right now, Puzzle is a useful top-down collaborative mapping tool. However, it relies entirely on human memory. Users often suffer from the "cold start" problem: they stare at a blank canvas because their most repetitive daily tasks have become invisible, automated habits. They don't know
what
to map.💡 Feature Request Description
Introduce a lightweight
Puzzle Browser Extension
that acts as a passive "Workflow Scout", bringing a MemoryLane-style approach directly into the browser.- It analyzes browser tab sequences, form inputs, and copy-paste patterns across SaaS apps.
- When it detects a repetitive sequence (e.g., repeating a 5-step process between HubSpot, Gmail, and a internal tool), it keeps a pattern history and optionally sends a push notification: "We noticed you did this sequence 3 times today. Click here to auto-generate a Puzzle blueprint."
- This transforms Puzzle from a reactive documentation tool into an active Process Discovery Engine.
🛠️ Implementation Suggestion
To avoid the security, privacy, and development nightmares of a full desktop app (like task-mining competitors do), start with a
Chromium Extension
.- Cross-Platform Support: A browser extension runs out-of-the-box across Windows, macOS, and Linux.
- The extension monitors URLs and DOM interactions locally.
- It uses a local script to cluster repetitive patterns.
- With one click, the user sends the raw text steps to Puzzle's AI to instantly generate the visual workflow on their dashboard.
🔑 Feasibility (BYOK)
To reduce AI infrastructure and token costs for Puzzle, this feature can run on a
BYOK (Bring Your Own Key)
model.- Users plug in their OpenAI-Compatible provider (BaseURL setup + API key)
- Puzzle incurs zero AI compute costsfor the background processing and text-to-map generation.
- This keeps the feature highly scalable, private, and predictable for your team to maintain.
📚 References
Examples of services using background task-mining to feed process intelligence:
B
Brian Ragone
Hey! Wow, how timely! We have this in our cross hairs. Thank you for writing out such a nicely spec'd feature request. I'd love to discuss your use case for this app directly, if you'd like to reach out to brian@puzzleapp.io