Healthcare Manufacturer Brings Generative AI to Regulated Data with Self-Hosted Aleph Alpha Kolibri
Learn how a healthcare manufacturer worked with StackVera to run Aleph Alpha Kolibri and open-weight frontier models on dedicated hardware in German data centers, ready in about four days and alongside its cloud services.
Challenge
A healthcare manufacturer in Germany saw an opportunity to use generative AI on its internal documents. Some of the documents with the highest value for AI are subject to strict regulatory requirements. They must stay on dedicated infrastructure under the company's control, so processing them with a hyperscaler or a US provider was not an option. As a result, teams could not use exactly the data that mattered most. The company did not want to move away from the cloud. It wanted an additional platform for regulated data: compliant with all applicable regulations, hosted in Germany, and able to run current models on dedicated hardware.
Approach
To build the platform, the company turned to StackVera. StackVera delivers on hyperscalers such as AWS as well as on self-hosted infrastructure, so it could design the platform to complement the company's existing cloud services rather than replace them. Because StackVera already operates the AI platform as a proven solution, it did not need to be built from scratch. StackVera self-hosts the entire platform on dedicated hardware in data centers of German providers. On this hardware, StackVera deployed Kolibri, a model from the German AI company Aleph Alpha. Aleph Alpha aligns Kolibri with European legal and regulatory standards, including the EU AI Act and its Codes of Practice, and designs it for sensitive workloads in the public sector and industry. Open-weight frontier models run on the same hardware, so teams can choose the right model for each task. Prompts, responses and documents never reach a third-party model API. StackVera then made the company's relevant documents available on the platform in a compliant way. When new open-weight models are released, StackVera can add them without any data leaving the platform.
Outcome
The platform was available to the company in about four days. Teams at the company now use generative AI on documents they previously could not use at all. Aleph Alpha Kolibri and open-weight frontier models work on regulated data that never leaves German data centers, and the company decides which models run on its platform. Workloads without these requirements continue to run on cloud services. Looking ahead, the company can bring more regulated data and new open-weight models onto the platform as its use of generative AI grows.