LLM, AI and RAG stuff

Meta

https://github.com/tensorchord/Awesome-LLMOps

RAG

https://github.com/griptape-ai/griptape
https://github.com/neuml/txtai
https://github.com/philippe2803/contentmap
https://philippeoger.com/pages/can-we-rag-the-whole-web
https://github.com/stanford-oval/storm
https://docs.llamaindex.ai/en/stable/ a framework for building context-augmented generative AI applications with LLMs including agents and workflows.
https://github.com/Mirascope/mirascope/ Mirascope is an elegant and simple LLM library for Python, built for software engineers. We strive to provide the developer experience for LLM APIs that requests provides for http.
https://app.vexpower.com/sim/automating-content-workflows-with-langgraph/
https://pub.towardsai.net/how-to-quickly-build-a-semantic-search-system-with-txtai-and-weaviate-fd4084e93aaa
https://medium.com/neuml/introducing-rag-with-txtai-f3456977cf91
https://github.com/weaviate/Verba

LLM engines

https://textsynth.app.nexedi.net/index.html
https://bellard.org/ts_server/
https://news.ycombinator.com/item?id=41105130
https://github.com/SylphAI-Inc/AdalFlow
https://github.com/pytorch/torchchat
https://github.com/vllm-project/vllm

ML

https://www.sematic.dev/ The open-source orchestrator loved by ML teams

Misc

https://www.tweag.io/blog/2024-05-21-work-daigest/
https://www.boundaryml.com/blog/structured-output-from-llms
https://python.useinstructor.com/prompting/
https://github.com/jxnl/instructor/

Applications

https://searchgrants.eu/search/
PhaidraAI: “For now, Aleph Alpha is settling into its new strategy. In July, it announced that government employees in its home state of Baden-Württemberg would soon start using the system now called PhaidraAI. During an interview, Andrulis briefly showed it off — an interface that lets public employees tap AI tools to do tasks like manage files, sift through documents or write emails. This shift moves away from merely competing in the generative AI model race and towards becoming a comprehensive provider of AI infrastructure that supports transparency and data sovereignty, especially under Europe’s AI regulations. Aleph Alpha continues to prioritize flexibility, transparency, and domain-specific optimization in its offerings, positioning itself as a critical partner for organizations looking for secure AI solutions.”

Article

https://www.scaleway.com/en/blog/your-rag-powered-ai-app-in-50-lines-of-code/

Theory

https://blog.miguelgrinberg.com/post/how-llms-work-explained-without-math
https://thellm.substack.com/p/llama-3-implemented-in-pure-numpy

Page last modified: 2024-09-16 11:45:04