Project Roadmap?

[jackprophesy]

I'm experimenting with the codebase to try to a P2P replication option... do you have a project roadmap or general idea of what features and improvements are next?

[ankur-anand]

Hi @jackprophesy, Glad to see you trying to do the P2P replication option. Yes, there are a few general ideas of features and improvements that next, I will put in the roadmap section soon. For your reference, here are some general ideas.

• Extend Engine API to support Value with TTL, probably each Value will get an envelope in flatbuffer.
• Add Compaction if TTL is Set.
• Run Engine in LOG_MODE, Only Pure Log Streaming, Mostly for DataLake.
• Stream Fabric -> LOG_MODE + Parallel Processing with operators.
• Merge API (Multi-Writer Sync) for LWW once the API to support TTL is added. Like your P2P replication.
• Consensus-lite control plane: For those who need it, it will be more like a router table component coordinator.
• Operational Tools.
• Docs update.

If you have anything on your mind that you would like to solve, please feel free to collaborate and reach out.