AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Pro Services › hamilton
✦ Free & open sourcePro Services

hamilton

Define testable, modular Python dataflows with built-in lineage and metadata.

Portable Data Transformation DAGs for Python

Build modular ETL, ML workflows, and LLM pipelines using standard Python functions and automatic DAG creation.

Free forever · open source · Apache-2.0
✓ Light setup✓ Browser-based✓ Real-time collaboration
8.3
ZEKAI
Modular Python data transformations
Free & open source · Pro Services
Ease of setup7
Usefulness9
Maintenance9.5
Community7.5
★ 2,620
GITHUB
Oct 2026
UPDATED
Apache-2.0
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

Apache Hamilton is a lightweight Python library for building directed acyclic graphs of data transformations using standard functions. It suits data scientists and engineers who want to organize code into testable, self-documenting pipelines that run anywhere Python runs.

Runs on
Cross-platform
Hosting
Self-host
Languages
Jupyter Notebook
License
Apache-2.0

What it is

It automatically builds a DAG from regular Python functions where parameters specify dependencies. Function modifiers keep code dry, and data adapters handle schema validation for pandas, polars, and Ibis.

Who it's for

It suits data teams transitioning proof-of-concept models into maintainable production pipelines without rigid orchestrator lock-in. It does not suit those looking for an orchestrator to schedule jobs or users who need loops and conditional agent logic.

Key features

Separation of Concerns

Separates DAG definition and execution so data scientists and engineers can collaborate effectively.

Environment Configuration

Uses @config.when() to modify DAGs between environments instead of error-prone if/else flags.

Schema and Data Validation

Decorate functions to validate output properties and automatically inspect dataframe schemas.

Hamilton UI and Tracking

Automatically populates a data catalog with lineage, tracing, and execution observability.

How to start

Up and running in 3 steps

1
Install the library with pip install apache-hamilton[visualization,ui,sdk].
2
Write regular Python functions where parameters define your data dependencies.
3
Build the driver with your modules and execute your DAG.
Real talk

Our honest verdict

What's great

  • Builds DAGs automatically from standard Python functions without bloated syntax.
  • Decouples transformations from orchestrators like Airflow so you can debug locally.
  • Function modifiers reduce code redundancy across large data pipelines.
  • Built-in Hamilton UI tracks execution results and automatically catalogs datasets.

Where it falls short

  • Not an orchestrator, meaning you still need separate infrastructure to schedule jobs.
  • Requires Graphviz installed on your system separately for DAG visualizations.
  • Running the Hamilton UI server requires managing local or Docker-deployed server state.
Cost

Pricing & license

Free under the Apache-2.0 licence, with the only cost being your own hosting resources if you run the Hamilton UI server.

Paid work

Open remote AI-training roles

880 open remote AI-training roles, updated November 15, 2026; most pay $20–$175 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

🎁 Free & open-source alternatives
Get more

Use it, or have us set it up

📄 Free PDF: hamilton for Pro Services
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure hamilton for you — and train your team.
Get it done for you ↗
Questions

FAQ

Is Apache Hamilton an orchestrator?

No, Hamilton is an asset-layer library for organizing data transformation code, not an operational system for creation like Airflow.

How does it handle different execution environments?

You can use @config.when() decorators to swap out logic based on configuration parameters instead of writing inline conditional statements.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Pro Services — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google