LLM in Python

• https://github.com/abetlen/llama-cpp-python = Python bindings for llama.cpp
• https://github.com/langchain-ai/langchain = Building applications with LLMs through composability
• https://github.com/advanced-stack/py-llm-core = A pythonic library providing light-weighted interface with LLMs
• https://github.com/dagworks-inc/burr = Build applications that make decisions (chatbots, agents, simulations, etc…). Monitor, persist, and execute on your own infrastructure.

Notes on LangChain

• https://www.octomind.dev/blog/why-we-no-longer-use-langchain-for-building-our-ai-agents
• https://www.reddit.com/r/LocalLLaMA/comments/1d4p1t6/is_langchain_usable/ “I don’t know you, but when I build an LLM app for a client LangChain is always more of a hassle to get started than just writing the ‘supporting’ code myself.”

#llm

Page last modified: 2024-12-09 23:29:05