At 900lbs, our CEO recently asked me to “help the team plan and develop an AI Agent” - this is my ongoing log of my exploration.

The Challenge⌗

Deitz asked me to brainstorm on “how to make an AI agent” that would include:

• Visual avatar (humanoid w/o lip-syncing) that could be a voice AI during Zoom, Teams, Google Meet conferences.

• Backend AI automations and LLM tools (RAG + MCP) that could support documentation and admin tasks and free Project Management and Account Management Team up 15%. (Ex: New Business Intake, Proposal and RFP Authoring, Requirements Gathering, Plan Documentation, and Misc. note taking and action items.)

Initial Approach⌗

I researched pipeline for creation and determined that we needed to document use cases and SOPs. I also wanted to explore development stacks a bit. I wrote initial use cases, including integration of APIs from ClickUp, Google Suite, Zoom, and Github, and I landed on possibility of a tool like HeyGen interactive characters combined with n8n + Crew AI. Possibly using a Next.JS and FastAPI python backend in use cases were a separate web app may be needed (ex: daily brief idea).

Personal Approach⌗

To make the research more impactful, I also considered some personal use cases. I wanted an AI agent that coordinate tools like AnyType (PARA second brain), Skylight (Family Tasks, Calendar, Meal Prep, Google Suite (Personal Cal, Email), and YNAB personal finance tool.

The project is in process!