LLFn has only one goal: making it 100x easier to experiment and ship AI applications using the LLMs with minimum boilerplate. Even if you're new to LLMs, you can still get started and be productive in minutes, instead of spending hours learning how to use the framework.

  • 🔋 Functionify: turning any prompt into a callable function.
  • ðŸ“Ī Flexible Output: defining LLM result with Python and pydantic types.
  • ðŸ§ą Infinitely Composable: any function can call any other function in any order.
  • 🛒 Use Any LLM: leveraging LangChain's LLM interface, drop in your favorite LLM with 100% compatibility.
  • ðŸŠķ Light-Weight: small core framework of LLFn making it extremely easy to understand and extend.

We draw a lot of inspiration from both FastAPI and LangChain, so if you're familiar with either of them you'd feel right at home with LLFn.