LLM Stuff
Collection of LLM tools, frameworks, and resources to do cool stuff.
llm
tools
resources
structured outputs
Name
Description
Link
instructor
Structured outputs powered by LLMs.
Visit →
outlines
A tool for Structured Text Generation
Visit →
serving framework
Name
Description
Link
sglang
Fast serving framework for large language models and vision language models.
Visit →
model guidance
Name
Description
Link
guidance
A guidance language for controlling large language models.
Visit →
Prompt Management
Name
Description
Link
promptflow
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
Visit →
DSPy
A framework for programming—not prompting—language models
Visit →
vector database
Name
Description
Link
lancedb
Multimodal vector database.
Visit →
qdrant
Vector search engine for AI applications.
Visit →
Home
Projects
Read
Watch
Lists
About