Platform & Infrastructure

Cloud-native AI platform capabilities and infrastructure.

45Projects4Subcategory68Tags
TrackedUnavailableArchivedInactive

Kubernetes-native AI infrastructure and scheduling.

Agent Substrate

Kubernetes-based system for managing agent workloads at scale, multiplexing many stateful actors onto fewer pods with sub-second activation and persistent state.

Stars --Last Commit --

dstack

Vendor-agnostic orchestration for training, inference, and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Stars --Last Commit --

Fluid

Elastic data abstraction and acceleration layer for BigData/AI applications on Kubernetes, enabling efficient data access through distributed caching.

Stars --Last Commit --

GPUWorks

An ultra-lightweight GPU management and Model-as-a-Service (MaaS) platform that pools bare-metal servers, public cloud instances, and private cloud VMs into one heterogeneous cluster across NVIDIA, AMD, Ascend, PPU, Hygon, and Apple Silicon accelerators, serving models behind an OpenAI-compatible endpoint.

Stars --Last Commit --

HolmesGPT

An AI agent platform for cloud-native environments that automates alert investigation, root cause analysis, and remediation suggestions.

Stars --Last Commit --

k8sgpt

An AI tool that provides diagnostic and analysis capabilities for Kubernetes, using LLM to locate and explain cluster issues.

Stars --Last Commit --

NVIDIA AI Cluster Runtime

NVIDIA AI Cluster Runtime (AICR) generates optimized, validated, and reproducible GPU-accelerated Kubernetes cluster configurations for AI training and inference.

Stars --Last Commit --

NVIDIA GPU Operator

NVIDIA GPU Operator automates deployment, configuration, and management of GPU components and drivers in Kubernetes.

Stars --Last Commit --

NVIDIA Run:ai

An open-source AI workload and GPU orchestration platform for Kubernetes, combining GPU-aware scheduling, fractional GPU allocation, quotas, governance, and observability to share GPU resources efficiently across teams and clusters.

Stars --Last Commit --

Olares

An open-source personal cloud OS built on Kubernetes, enabling self-hosted AI agents, local model serving, and private data sovereignty.

Stars --Last Commit --

Open WebUI

A scalable, feature-rich web interface for interacting with large language models, providing a ChatGPT-like experience with support for multiple models and customization options.

Stars --Last Commit --

TauGrid

Cloud-native AI infrastructure that runs, schedules, and monitors AI workloads on GPU-enabled Kubernetes clusters, from data preparation to distributed training, fine-tuning, and inference.

Stars --Last Commit --

Unifabric

Cloud-native observability for the high-speed networks of AI clusters, covering RDMA, RoCE/InfiniBand, and NVLink, and attributing network traffic to Kubernetes workloads.

Stars --Last Commit --

VM Operator

VM Operator enables management of virtual machines with a Kubernetes-style, declarative API. It turns VMs into first-class Kubernetes resources so platform teams can offer self-service virtual infrastructure.

Stars --Last Commit --

Volcano

Volcano is a Kubernetes-native batch scheduling system (a CNCF project) that enhances kube-scheduler with advanced features for batch, HPC, and AI workloads.

Stars --Last Commit --

Data platforms, lakehouse stacks, and data services.

3FS

A high-performance distributed file system designed for AI training and inference workloads, optimizing parallel I/O and data locality to support large-scale training.

Stars --Last Commit --

AIPyApp

An open-source tool that integrates an interactive Python environment with LLMs for natural-language-driven Python execution and automation.

Stars --Last Commit --

Apache Doris

Apache Doris is an easy-to-use, high-performance unified analytics database for real-time and offline analysis.

Stars --Last Commit --

Apache Iceberg

A high-performance table format for huge analytic tables, offering snapshots, transactions and multi-engine compatibility. Widely used in AI data pipelines and ML feature stores.

Stars --Last Commit --

Apache Spark

A unified analytics engine for large-scale data processing, supporting batch, streaming and machine learning workloads.

Stars --Last Commit --

Apache Superset

An open-source data visualization and exploration platform supporting interactive dashboards, SQL-based analysis, and multiple data sources.

Stars --Last Commit --

cuDF

A GPU DataFrame library for accelerating data analysis and tabular computing with GPU acceleration.

Stars --Last Commit --

CVAT

CVAT is an industry-leading computer vision annotation tool suitable for annotation at any scale.

Stars --Last Commit --

Dagster

A cloud-native orchestration and development platform for data assets, with strong observability and a developer-friendly programming model.

Stars --Last Commit --

Dask

Dask is a Python library for parallel computing and task scheduling, suited for scaling NumPy, Pandas and machine learning workloads across clusters.

Stars --Last Commit --

Datachain

ETL, analytics, and versioning for unstructured data to build reproducible and auditable data pipelines.

Stars --Last Commit --

DataFlow

A data preparation and pipeline platform for domain training and retrieval-augmented generation.

Stars --Last Commit --

DocuTranslate

DocuTranslate is a lightweight document translation tool leveraging LLMs and multiple parsing engines.

Stars --Last Commit --

DuckDB

An analytical, in-process SQL database suited for interactive queries, ETL, and local analytics.

Stars --Last Commit --

Jupyter Notebook

Interactive computing environment widely used for data science and machine learning development.

Stars --Last Commit --

Label Studio

Label Studio is a multi-type data labeling and annotation tool with standardized output formats.

Stars --Last Commit --

Proton

Proton is a single-binary C++ high-performance SQL stream processing engine designed for real-time analytics and stream ETL.

Stars --Last Commit --

Unstract

A no-code LLM platform to convert unstructured documents into structured data and quickly launch APIs and ETL pipelines.

Stars --Last Commit --

Valkey

A high-performance distributed key-value database optimized for caching and real-time workloads.

Stars --Last Commit --

Security policy, access control, and compliance tooling.

Agent Governance Toolkit

A toolkit for policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents, covering all 10 OWASP Agentic Top 10 risks.

Stars --Last Commit --

BailingHub

Open-source A2B control plane based on Agent Capability Contracts for safely connecting agents to existing business systems.

Stars --Last Commit --

Strix

Open-source AI penetration testing tool that finds and fixes your application's vulnerabilities with autonomous security agents.

Stars --Last Commit --

Deployment pipelines and operations tooling.

CSGHub

An open-source platform for LLM asset and lifecycle management, offering SaaS and on-premise deployment with Python SDK compatibility.

Stars --Last Commit --

KitOps

KitOps is a CNCF-backed open-source project that standardizes packaging AI/ML projects into signable, versioned OCI artifacts.

Stars --Last Commit --

LMDeploy

LMDeploy is a toolkit for compressing, deploying and serving large language models, providing optimized inference engines, quantization and distribution features.

Stars --Last Commit --

MLC LLM

MLC LLM is a machine learning compiler and deployment engine that enables high-performance LLM inference across platforms using compilation and runtime optimizations.

Stars --Last Commit --

MLflow

MLflow is an open-source platform for managing the machine learning lifecycle, including experiment tracking, packaging, model registry and deployment.

Stars --Last Commit --

MLRun

MLRun is an open-source MLOps platform for building and managing continuous ML applications across their lifecycle.

Stars --Last Commit --

MLX

An array framework for machine learning optimized for Apple Silicon, offering NumPy-like Python APIs plus C++, C and Swift bindings.

Stars --Last Commit --

workerd

workerd is Cloudflare's open-source JavaScript/Wasm server runtime designed to run Workers-compatible nanoservices and edge applications in local or self-hosted environments.

Stars --Last Commit --