Active Pieces Base

[saashqdev]

Hi: Could Data-Story be used as the base for something like ActivePieces? Great idea / interface btw.

[ajthinking]

Hi @saashqdev !
Certainly! Consider this simplified example:

Database entities

• Users
• Diagrams
• Executions
• Schedules
• Endpoints
• Triggers

Pages

• /diagrams/create
• /diagrams/edit

Custom provider

Make an app provider that provides any custom nodes needed.

Use cases

When the user creates/edits a diagram your page uses @data-story/ui to render the workbench.
When a user saves a Diagram, it is serialized to JSON and put into database.
When executing it, a new database record "execution" is created.
The execution may be offloaded to a job or serverless env where only @data-story/core is used.
Schedules, endpoints and triggers etc could be built but they are not on the roadmap atm.

Ill be happy to assist with this. Right now many features are still in development. Feel free to name features you might need.

[saashqdev]

That's great news! I'm going to try and add Data-Story to my OSS project demo.saashq.org. I've been looking to add automation tools to it and Data Story fits perfectly. I've added a rough outline of the back-end database schema. If you do have some time to help out it would be greatly appreciated. There's a gig there if you want to set it up to get me going in the right direction. I can help as well. I'm a dev, just not familiar with React Flow. Maybe something like Inngest or trigger.dev on the back-end may help?

I'm roughly modelling off of: https://github.com/AlexandroMtzG/remix-workflows This is, however, in Remix. Maybe a Data-Story / Nextjs version of this...The beauty of our model is that it's OSS and a starter kit, so the features don't necessarily need to be fully fleshed out.

workflow.sql.tar.gz

[ajinvise]

Sounds awesome!

workflow.sql.tar.gz

Prisma 🤟

So the workflow implementation would be going into this repo: https://github.com/saashqdev/saashq right?
Before helping you out there are some things we really need to fix, like open/save/serialize etc. So let me work on that for a bit and get back shortly when we are in a more "installable state". Your implementation is a very good case to test platform details so looking forward to it 👍

Until then, Merry christmas 🎉

[saashqdev]

Ah very cool. I'm super excited about this and your efforts. Have a great holiday as well! Cheers, Dave (oh, and yes, that's the correct repo).

[saashqdev]

I've been in contact with Nisarg, the dev who created: https://workflow-engine-ui-r.pages.dev/ He was kind enough to port his backend workflow engine to Nextjs (from Nestjs) - https://github.com/nisargrbhatt/nextjs-vm-test. Is there anything there that you could use? (from a back-end perspective?). Cheers, Dave

[ajthinking]

Hi Dave!
Sorry for the late action here, we have been a little bit side tracked.

Is there anything there that you could use

Yes, its basically the same approach we need! Very good 👍

Would you like to get on a call and discuss the implementation a bit? If you want, drop me an email (visible at my profile) and we can find a time!

[saashqdev]

No problem. I integrated Nisarg's code yesterday and I just need to add a "Workflow" menu item to the sidenav and wire it up. Once I've done that I'll get in touch and we can see where we're at.