Flyte MCP Server

[!IMPORTANT]

Flyte 2 is now generally available!

Read more in the announcement here.

Want to try Flyte 2 locally? Run the Devbox locally, or you can try it on Github Codespaces.

Looking for Flyte 1? Go to the master branch, where Flyte 1 is now maintained.

---

Flyte 2

Reliably orchestrate ML pipelines, models, and agents at scale — in pure Python.

Flyte is a Graduated project of the LF AI & Data Foundation.

<a href="https://lfaidata.foundation/projects/flyte/"> <img src="https://raw.githubusercontent.com/flyteorg/static-resources/main/flyte/readme/flyte_and_lf.png" alt="Flyte and LF AI & Data Logo" width="250"> </a>

10 minutes to Flyte 2

The quickest way to get a feel for Flyte 2 is in this notebook:

Install

uv pip install flyte

For the full SDK and development tools, see the flyte-sdk repository.

Example

import asyncio
import flyte

env = flyte.TaskEnvironment(
    name="hello_world",
    image=flyte.Image.from_debian_base(python_version=(3, 12)),
)

@env.task
def calculate(x: int) -> int:
    return x * 2 + 5

@env.task
async def main(numbers: list[int]) -> float:
    results = await asyncio.gather(*[
        calculate.aio(num) for num in numbers
    ])
    return sum(results) / len(results)

if __name__ == "__main__":
    flyte.init()
    run = flyte.run(main, numbers=list(range(10)))
    print(f"Result: {run.result}")

<table> <tr><td><b>Python</b></td><td><b>Flyte CLI</b></td></tr> <tr> <td>

python hello.py

</td> <td>

flyte run hello.py main --numbers '[1,2,3]'

</td> </tr> </table>

Serve a Model

# serving.py
from fastapi import FastAPI
import flyte
from flyte.app.extras import FastAPIAppEnvironment

app = FastAPI()
env = FastAPIAppEnvironment(
    name="my-model",
    app=app,
    image=flyte.Image.from_debian_base(python_version=(3, 12)).with_pip_packages(
        "fastapi", "uvicorn"
    ),
)

@app.get("/predict")
async def predict(x: float) -> dict:
    return {"result": x * 2 + 5}

if __name__ == "__main__":
    flyte.init_from_config()
    flyte.serve(env)

<table> <tr><td><b>Python</b></td><td><b>Flyte CLI</b></td></tr> <tr> <td>

python serving.py

</td> <td>

flyte serve serving.py env

</td> </tr> </table>

Local Development Experience

Install the TUI for a rich local development experience:

uv pip install flyte[tui]

Open Source Backend

The open source Flyte 2 backend is available in this repository. You can deploy it on your own Kubernetes cluster using Helm. See the deployment docs for setup instructions and the Backend README for backend architecture and development.

If you need an enterprise-ready, production-grade backend for Flyte 2 today, it is available on Union.ai.

Learn More

• Try DevBox - Get started
• Try Devbox in Github Codespaces - Get started in the browser
• SDK Reference — API reference docs
• CLI Reference — CLI docs
• flyte-sdk — The Flyte 2 Python SDK repository
• Slack | GitHub Discussions | Issues

Contributing

We welcome contributions! See the Backend README for backend development, or join us on slack.flyte.org.

Sponsors

CI container image builds for this repository are sponsored by Depot — fast, native multi-arch Docker builds with persistent layer caching.

License

Apache 2.0 — see LICENSE.