LLM, AI and RAG stuff

Meta

https://github.com/tensorchord/Awesome-LLMOps

RAG

See RAG

LLM engines

https://textsynth.app.nexedi.net/index.html
https://bellard.org/ts_server/
https://news.ycombinator.com/item?id=41105130
https://github.com/SylphAI-Inc/AdalFlow
https://github.com/pytorch/torchchat
https://github.com/vllm-project/vllm

ML

https://www.sematic.dev/ The open-source orchestrator loved by ML teams

Misc

https://www.tweag.io/blog/2024-05-21-work-daigest/
https://www.boundaryml.com/blog/structured-output-from-llms
https://python.useinstructor.com/prompting/
https://github.com/jxnl/instructor/

Applications

https://searchgrants.eu/search/
PhaidraAI: “For now, Aleph Alpha is settling into its new strategy. In July, it announced that government employees in its home state of Baden-Württemberg would soon start using the system now called PhaidraAI. During an interview, Andrulis briefly showed it off — an interface that lets public employees tap AI tools to do tasks like manage files, sift through documents or write emails. This shift moves away from merely competing in the generative AI model race and towards becoming a comprehensive provider of AI infrastructure that supports transparency and data sovereignty, especially under Europe’s AI regulations. Aleph Alpha continues to prioritize flexibility, transparency, and domain-specific optimization in its offerings, positioning itself as a critical partner for organizations looking for secure AI solutions.”

Article

https://www.scaleway.com/en/blog/your-rag-powered-ai-app-in-50-lines-of-code/

Theory

https://blog.miguelgrinberg.com/post/how-llms-work-explained-without-math
https://thellm.substack.com/p/llama-3-implemented-in-pure-numpy

#agents #workflows #apis

Page last modified: 2024-11-18 15:42:08