[V2] feat: Dockerfile for each components

[lowc1012]

Tracking issue

Related to Flyte v2 (#7203)

Why are the changes needed?

1. Create Dockerfile for each v2 components
2. Use Buildx Bake to manage monorepo Docker builds and build them in parallel

What changes were proposed in this pull request?

How was this patch tested?

Labels

Please add one or more of the following labels to categorize your PR:

• added: For new features.
• changed: For changes in existing functionality.
• deprecated: For soon-to-be-removed features.
• removed: For features being removed.
• fixed: For any bug fixed.
• security: In case of vulnerabilities

This is important to improve the readability of release notes.

Setup process

Screenshots

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

Docs link

• main
  • Flyte 2: Cut over to Flyte 2 new backend implementation #6583
    • [V2] feat: Dockerfile for each components 👈

[lowc1012]

@popojk Please take a look this PR, thanks

[popojk]

Hey @lowc1012 , thanks for your contribution! I just left a few comments. BTW, could you also check:

1. I don't see the dockerfile for secret service in the PR. Would you mind add one?
2. I don't see helm charts changes in this PR. Are you gonna do it in another PR?

[popojk]

All good except 1 small issue then we are good to go. @pingsutw Would you mind also take a look at this?

[pingsutw]

Instead of building ARM and AMD images in separate jobs, could we build a multi-arch image in a single job. like

flyte/.github/workflows/flyte-binary-v2.yml

Lines 220 to 225 in 38fb221

	platforms: linux/arm64, linux/amd64
	tags: ${{ steps.gpu-image-names.outputs.tags }}
	build-args: |
	FLYTE_DEVBOX_VERSION=${{ env.FLYTE_DEVBOX_VERSION }}
	BASE_IMAGE=base
	push: ${{ github.event_name == 'push' || github.event_name == 'workflow_dispatch' }}

[pingsutw]

Could we add a dockerfile for the app service too

[pingsutw]

Also, we just merged the v2 branch into main, could you update the base branch to main?

[lowc1012]

Could we add a dockerfile for the app service too

@pingsutw, curious about how to start the AppService?