Skip to main content

Weka Storage

Bridge is adding support for WEKA (WekaFS) as a high-performance storage option for AI and HPC workloads. WEKA integration follows the same storage controller architecture used for VAST and DDN — a Kubernetes-based controller manages tenant onboarding, quota enforcement, and network isolation through the WEKA management API.

Current Status

WEKA storage integration is in progress. The following capabilities are planned:

FeatureStatus
WEKA management API integrationIn progress
Per-tenant WEKA organization / namespaceIn progress
NFS-over-WEKA mount for compute nodesIn progress
S3 protocol support on WEKAIn progress
Per-tenant quota enforcementIn progress
Storage network isolation (VRF / VxLAN)In progress

Architecture Overview

WekaFS is a distributed parallel filesystem that runs on standard NVMe servers or on dedicated WEKA storage appliances. It supports both NFS and S3 protocols and is commonly used for AI training, checkpoint storage, and large-scale dataset access.

The Bridge WEKA storage controller will:

  1. Communicate with the WEKA management cluster over the WEKA REST API.
  2. Create per-tenant organizations or filesystems in WEKA at tenant onboarding time.
  3. Apply per-tenant storage quotas.
  4. Configure NFS exports scoped to the tenant's storage subnet.
  5. Mount WEKA NFS shares on compute nodes via the tenant's isolated storage network.
  • Storage Overview — Supported storage systems and multi-tenancy model
  • VAST — VAST Data storage integration (currently supported)
  • DDN — DDN Lustre storage integration (currently supported)