#
ai-infra
Here are 170 public repositories matching this topic...
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
agent security scanner vulnerability ai-safety security-tools ai-security ai-infra mcp-scan llm prompt-injection llm-security llm-evaluation prompt-security agentic-ai agent-security ai-red-teaming openclaw-security skill-scanner llm-jailbreak
-
Updated
Oct 29, 2026 - Python
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
distributed-systems performance-engineering book gpu accelerator mixture-of-experts kv-cache ai-infra llm llm-serving llm-training llm-inference deepseek ai-infrastructure datacenter-network
-
Updated
Oct 1, 2026 - Python
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
-
Updated
Jul 25, 2025
⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
visualization python training tracking data-science machine-learning deep-learning tensorflow logging transformers pytorch tensorboard model-versioning mlops ai-infra llm
-
Updated
Oct 29, 2026 - Python
TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
rcm distillation video-generation mlsystem diffusion-models inference-acceleration ai-infra consistency-model sageattention sparse-linear-attention
-
Updated
Aug 27, 2026 - Python
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
attention vit quantization video-generation mlsys inference-acceleration ai-infra vision-transformer sparse-attention llm sageattention
-
Updated
Feb 25, 2026 - Cuda
AI-Native & Cloud-Native FS: A high-performance file semantic layer for cloud object storage, integrated with high-speed cache. CNCF Sandbox Project.
agent rust ai s3 cloud-native model-training lance sandbox-environment ai-infra ai-native lancedb vllm-plugins ai-memory-bank s3-files
-
Updated
Oct 29, 2026 - Rust
Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications
sandbox rl code-execution ai-agents sandboxes ai-infra llm code-interpreter ai-infrastructure tensorlake
-
Updated
Oct 29, 2026 - Rust
The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.
-
Updated
Oct 23, 2026 - Python
hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等
-
Updated
Apr 27, 2026 - Cuda
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
transformer video-generation mlsys inference-acceleration ai-infra linear-attention sparse-attention diffusion-transformer train-acceleration sparse-linear-attention
-
Updated
Oct 18, 2026 - Python
Implement a Pytorch-like DL library in C++ from scratch, step by step
-
Updated
Apr 15, 2026 - C++
🧬 Symbio（共生）- AI Infra 级多 Agent 协同框架 | 33 Killer Features: 动态 DAG, 本体化记忆, 防过早完成, 数据飞轮, 神经符号安全, OpenTelemetry 可观测, HITL 人类介入, MCP 原生支持, 语义缓存, PromptOps, 边缘计算, 隐私计算 | Next-Gen AI Infrastructure for Multi-Agent Orchestration
-
Updated
Jul 29, 2026 - Python
Give AI coding agents the context they need to ship production-quality software.
infrastructure rust cli hooks ai opencode gemini cursor ai-agents ai-infra ai-assistant ai-tools ai-agent bitloops ai-infrastructure claude-code
-
Updated
Jun 1, 2026 - Rust
Agent-Sandbox is an easy-to-use, enterprise-grade sandbox platform for AI Agents — letting them securely run untrusted LLM-generated code, Browser use, Computer use, and deploy websites, among other tasks.
agent mcp sandbox container kubernetes-native code-executor ai-infra agent-sandbox computer-use browser-use ai-sandbox e2b-compatible
-
Updated
Oct 29, 2026 - Go
Transform your pythonic research to an artifact that engineers can deploy easily.
kubernetes data-science machine-learning production ml data-engineering feature-extraction dataops feature-engineering raptor model-deployment kubeflow mlops ai-infra featurestore raptor-ml feature-platform reactive-ml
-
Updated
Jan 31, 2026 - Go
A collection of specialized agent skills for AI infrastructure development, enabling Claude Code to write, optimize, and debug high-performance systems.
-
Updated
Jul 9, 2026 - Python
This is a landscape of the infrastructure that powers the generative AI ecosystem
-
Updated
Oct 16, 2024 - HTML
Add this topic to your repo
To associate your repository with the ai-infra topic, visit your repo's landing page and select "manage topics."