---
source_url: "https://todatabeyond.substack.com/p/6-open-source-llm-tools-you-should"
title: "6 Open Source LLM Tools You Should Know - by Youssef Hosni"
mirrored_at: 2026-08-26T03:01:45.263Z
host: todatabeyond.substack.com
cited_in_42a: true
mirror_canonical: "https://index.42a.ai/todatabeyond.substack.com/p/6-open-source-llm-tools-you-should"
---

> **Original source:** https://todatabeyond.substack.com/p/6-open-source-llm-tools-you-should

[Get 50% off for 1 year](https://youssefh.substack.com/subscribe?coupon=c00b291d&utm_content=162876142)

As the open-source ecosystem around Large Language Models (LLMs) continues to grow, developers and researchers are building an impressive set of tools to simplify everything from training to inference.

In this blog post, we spotlight six standout open-source projects — **Transformer Lab**, **STORM**, **LLMs.txt Generator**, **YourBench**, **LiteLLM**, and **LoRAX** — that address real-world challenges like benchmarking, serving, and managing fine-tuned models at scale.

Whether you’re fine-tuning models, evaluating their performance, or deploying them in production, these tools offer practical solutions to help streamline your workflow and make LLM development more accessible and efficient.

1.  **[Transformer Lab — Open Source LLM Toolkit](https://transformerlab.ai/)**
    
2.  **[STORM](https://storm.genie.stanford.edu/)**
    
3.  **[LLMs.txt generator](https://www.llmstxt.new/)**
    
4.  **[YourBench](https://huggingface.co/yourbench)**
    
5.  **[LiteLLM](https://github.com/BerriAI/litellm)**
    
6.  **[LoRAX: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs](https://github.com/predibase/lorax)**
    

**[Transformer Lab](https://transformerlab.ai/)** is a 100% open-source toolkit for Large Language Models. You can use the Transformer Lab toolkit to train, tune, and chat with LLMs on your own Machine.

-   One-click Download Hundreds of Popular Models
    
-   Download any LLM from Huggingface
    
-   Fine-tune / Train Across Different Hardware
    
-   RLHF and Preference Optimization
    
-   Work with LLMs Across Operating Systems
    
-   Chat with Models
    
-   Use Different Inference Engines
    
-   Evaluate models
    
-   RAG (Retrieval Augmented Generation)
    
-   Build Datasets for Training
    
-   Calculate Embeddings
    
-   Full REST API
    
-   Run in the Cloud
    
-   Convert Models Across Platforms
    
-   Plugin Support
    
-   Embedded Monaco Code Editor
    
-   Prompt Editing
    
-   Inference Logs