🧠 MTFIFO: A Minimalist Multi-Threaded FIFO Orchestrator for AI (javascript)

A super-light asynchronous task orchestrator that distributes queued requests across a pool of async functions ("threads"), preserving FIFO order — ideal for real-time apps, agents, or any async-heavy workload.

🚀 Ultra-Light. Dynamic. Runs Anywhere.

🧩 What is MTFIFO?

MTFIFO is a zero-dependency FIFO-first async job manager. It lets you:

Schedule many concurrent task requests
Distribute them over custom thread functions
Maintain FIFO discipline
Get notified on success, failure, or all-done

It’s designed for developers building custom task pipelines, async microservices, or AI agents — where every millisecond and execution order matters.

🧠 Why It Matters

Modern async systems are:

⚡ High-throughput (massive request volume)
🔄 Unpredictable (varying task times, streaming, retries)
🧬 Fine-grained (micro-inference, micro-decisions)
🎯 Deterministic-demanding (AI agents, reproducibility, latency guarantees)

But most orchestration tools are:

🏋️‍♂️ Too bloated (framework-heavy, dependency-locked)
🪵 Too rigid (static pipelines, no reactive control)
🛑 Not low-level enough (can’t “touch the metal”)

MTFIFO-JS solves this with:

✔️ Minimalism — Zero-dependency, browser/server-ready
✔️ Determinism — Explicit queueing, FIFO handling, and state clarity
✔️ Performance — Threaded execution, micro-latency tuning
✔️ Control — You define the logic, timing, and routing

Built for builders. Meant for systems where you want precision, not just “it works.”

✅ Features

FIFO queue management
Native setInterval-based polling
Event hooks for "SUCCESS", "ERROR", "END"
Dynamic thread pool resizing
Lightweight: <150 lines, no dependencies

🧩 Core API

`new MTFIFO({ THREADS })`

Start the pool with custom thread handlers (async functions).

const pool = new MTFIFO({ THREADS: [async (req) => req.func(req.params)] });

`.on(event, callback)`

Listen for task results or lifecycle events:

pool.on("SUCCESS", (res) => console.log("✔️", res));
pool.on("ERROR", (e) => console.warn("❌", e));
pool.on("END", () => console.log("🏁 All done"));

`.add_requests(requests)`

Add one or more tasks to the pool.

pool.add_requests([
  { params: { input: "someData" }, func: myAsyncFunc }
]);

`.add_threads(threads)`

Inject more thread handlers at runtime:

pool.add_threads([
  async (request) => request.func(request.params)
]);

`.Start()` and `.Stop()`

Control polling manually if needed (starts automatically on .add_requests()).

🧪 Quick Example

const THREADS = Array.from({ length: 3 }, () => async (req) => req.func(req.params));

const pool = new MTFIFO({ THREADS });

const REQUESTS = Array.from({ length: 10 }, (_, i) => ({
  params: { id: i },
  func: async ({ id }) => {
    console.log(`START ${id}`);
    await new Promise(res => setTimeout(res, Math.random() * 2000));
    console.log(`END ${id}`);
    return `Result ${id}`;
  }
}));

pool.on("SUCCESS", (res) => console.log("✔️", res));
pool.on("ERROR", (e) => console.warn("❌", e));
pool.on("END", () => console.log("✅ All done"));

pool.add_requests(REQUESTS);

🧠 Ideal For:

Custom agent pipelines
Async-heavy APIs
Web scraping engines
Multi-user LLM backends
Anywhere async order matters

🛠 Install & Use

git clone https://github.com/Muad-Bohmosh/mtfifo-js
cd mtfifo-js
node index.js

Or install globally:

npm install mtfifo-js

📣 Use It as you please under LICENSE terms

Like everything else, I Built it Because I Needed it.

📄 License

see the LICENSE file for details.

Contributions welcome. — thanks in advance!

FilesExpand file tree

README.md

Latest commit

History