Athena scales AI across its organization with Humanloop
Athena is the leading provider of outsourced Executive Assistants (EAs). Athena recognized the huge opportunity of AI and Large Language Models (LLMs) to augment their EAs and allow them to offer a superior service at a lower price point to 1,000s of companies and individuals.
Athena needed a developer platform to quickly automate workflows with LLMs
Athena was looking to automate its workflows - both internal and customer-facing - with LLMs. Their workflows were extremely diverse and they couldn’t find an automation platform that they could buy off the shelf. Instead they wanted an AI development environment that would let them create their own customised automations quickly.
The ideal platform had to:
- Feature an LLM sandbox compatible with various model providers (like OpenAI, Anthropic, Cohere)
- Support token streaming
- Securely archive all LLM-associated data
- Facilitate smooth API integrations and user-friendly operation
- Excel in scalability
The team considered several alternatives but other LLM developer platforms did not seem to be as comprehensive or as well integrated as Humanloop.
Humanloop’s infrastructure helped scale LLMs across Athena
Athena leveraged the Humanloop platform to integrate LLMs across their organization and quickly move automations from prototype to production at scale. The team uses Humanloop to prompt LLMs, prototype rapidly and design complex workflow automation across APIs.
For example, Athena’s team has automated the process of matching clients and Executive Assistants. They use LLMs to assess every possible match allowing the team to focus their time and attention on the matches the AI deemed most suitable.
Today Athena has a library of ready-to-use prompts and more complex automation tasks that its team can build on and easily adapt as needed.
In the process Humanloop has become a rich system of record for Athena’s LLM related data like model inputs, model generations and related metadata. Because Athena has all its data in one central place, the team feels confident that they can continuously improve its LLM applications.
An AI-empowered organization
Humanloop has helped Athena implement AI and LLMs at an unprecedented speed at scale. Over 1,000 team members at Athena now effectively leverage LLMs both internally and with their customer. In just a matter of months its team has created 100s of LLM powered automations with more being created every day allowing Athena to deliver a superior service to their customers at an improved cost base.
