Fundaments Labs: Private AI Workbench

Fundaments Labs

In this series, we are introducing a Fundaments Lab project: the Private AI Workbench, which offers an easy entry point for any user looking to implement an AI model. This may not sound like news, as many (public) cloud providers already offer this. But what if this AI needs to be applied to sensitive, business-critical data? That requires a controlled approach, ensuring that no one—or nothing, such as another AI model—can walk away with that data. With the Private AI Workbench currently being developed in our Lab, private & sovereign cloud capabilities meet AI application: a 100% guarantee of data protection from technical, legal, and operational perspectives. Your data stays in a Dutch cloud, fully compliant with Dutch and EU legislation, and is managed transparently by a Dutch organization.

‍

Private AI

The Private AI Workbench is designed to allow you to process your data with AI in a private cloud solution. This concept ensures that your data is handled within a secure, controlled environment. The environment is deployed from Fundaments' data centers, is not connected to the public internet, and does not utilize standard AI model services (such as ChatGPT/Gemini). This ensures your sensitive data remains under your management and Fundaments' control.

By utilizing our own Private Cloud infrastructure, optimized for AI processing, your sensitive data can be both trained and combined using Retrieval Augmented Generation (RAG). This is illustrated in the diagram below:

‍

What does the Private AI Workbench offer?

The Private AI Workbench provides a concept where anyone wanting to work with AI models gains access to a Private Cloud with AI-optimized hardware. The entire setup is highly accessible, both in terms of ease of use and cost.

It is structured as follows:

‍

• Private Cloud: From one of Fundaments' data centers, we provide physical server hardware optimized for AI model usage. This includes NVMe storage for fast model loading and switching, as well as a GPU for processing AI model transactions (tokens). This hardware is virtualized and equipped with workbench tools: AI models, an interface, and access to the entire environment, allowing for isolated work within a 'sandbox'.
• Access is provided via a VPN with an encrypted connection, ensuring the Private Cloud is fully protected.
• ‍Ollama framework: This allows for the installation and configuration of various (language) models. These are delivered ready-to-use, so you can get started immediately.
• OpenWebUI / LibreChat: This user interface allows you to deploy AI models, as well as load and switch between them. Furthermore, this interface provides options for storing files and having them processed by the AI model.
• ‍N8n: To deploy AI models automatically, the Private AI Workbench offers workflow automation. Data can be processed by one or more AI models within this framework. It is an ideal starting point for your first AI automation project.

‍

The Private AI Workbench is focused on easily harnessing the power of AI and rolling out proof-of-concepts that are accessible and cost-effective. At Fundaments Labs, we are looking for partners who want to contribute ideas and help us further develop the workbench.

• Are you developing an application that requires AI support?
• Are you a start-up looking for a scalable AI solution?
• Or do you want full control over your data in a data model of your choosing?

Please contact us so we can share Fundaments Labs with you.

‍