Skip to content

docs: blog post "Self-Improving AI Systems: A Log-Analysis Agent on NVIDIA DGX Spark" - #579

Merged
bilgeyucel merged 13 commits into
mainfrom
blog/self-improving-agent-dgx-spark
Oct 7, 2026
Merged

bilgeyucel merged 13 commits into
mainfrom
blog/self-improving-agent-dgx-spark

Conversation

@julian-risch

@julian-risch julian-risch commented Sep 25, 2026 •

Copy link
Copy Markdown
Member

Related Issues

Related code is in deepset-ai/haystack-core-integrations#3932 (draft)

Proposed Changes:

  • New blog post content/blog/self-improving-agent-dgx-spark/index.md: a Haystack optimizer agent that reads recorded traces of a citizen-services assistant, edits its configuration, measures each candidate and recommends the best one, with every model call on one NVIDIA DGX Spark.
  • thumbnail.png: photo of the DGX Spark.
  • fig1-self-improving-loop.png: architecture diagram of the optimization loop.
  • dense-vs-moe.png: single-stream throughput of four local models, with and without speculative decoding, generated from the numbers in the post's table.

How did you test it?

Preview https://haystack-home-git-blog-self-improving-agent-d-d223e9-deepset-ai.vercel.app/blog/self-improving-agent-dgx-spark

Notes for the reviewer

The date/last_updated fields are placeholders for the publication date.

Checklist

  • I have read the contributors guidelines and the code of conduct
  • I have updated the related issue with new insights and changes — n/a, no issue
  • I added unit tests and updated the docstrings — n/a, blog post
  • I've used one of the conventional commit types for my PR title: fix:, feat:, build:, chore:, ci:, docs:, style:, refactor:, perf:, test:.

🤖 Generated with Claude Code

Uploading image.png…

…on NVIDIA DGX Spark"

New post with thumbnail, architecture diagram (Fig. 1) and a dense-vs-MoE throughput chart (Fig. 2).
Numbers come from three experiments run on one DGX Spark with Nemotron 3.5 Lightning against the
civic MultiHop-RAG dataset, plus the throughput benchmarks in deepset-ai/dgx-spark.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@vercel

vercel Bot commented Sep 25, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
haystack-home Ready Ready Preview Oct 7, 2026 8:16am UTC

Request Review

@github-actions

github-actions Bot commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Status Count
🔍 Total 388
🔗 Unique 120
✅ Successful 337
⏳ Timeouts 0
🔀 Redirected 25
👻 Excluded 49
❓ Unknown 0
🚫 Errors 2
⛔ Unsupported 0

Errors per input

Errors in ./public/blog/self-improving-agent-dgx-spark/index.html

  • [ERROR] file:///home/runner/work/haystack-home/haystack-home/public/blog/self-improving-agent-dgx-spark/self-improving-agent-dgx-spark/dense-vs-moe.png (at 1695:34) | File not found. Check if file exists and path is correct
  • [ERROR] file:///home/runner/work/haystack-home/haystack-home/public/blog/self-improving-agent-dgx-spark/self-improving-agent-dgx-spark/fig1-self-improving-loop.png (at 1511:34) | File not found. Check if file exists and path is correct

Full Github Actions output

@julian-risch
julian-risch marked this pull request as ready for review September 25, 2026 15:02
@julian-risch
julian-risch requested a review from a team as a code owner September 25, 2026 15:02
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
julian-risch and others added 4 commits September 28, 2026 12:59
The LocalRunStore API no longer exists on the PR branch; the snippet now matches commit 15bc78075
of haystack-core-integrations#3932 and links to it so readers can reproduce the runs.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…suggestion)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…th paragraph (review suggestion)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
… bandwidth paragraph (review suggestion)"

This reverts commit 88a5409.
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
Co-authored-by: Julian Risch <julianrisch@gmx.de>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

@bilgeyucel bilgeyucel left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love the work! Left some comments to make some point more clear

Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
Comment thread content/blog/self-improving-agent-dgx-spark/index.md
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated
Co-authored-by: Bilge Yücel <bilge.yucel@deepset.ai>
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Comment thread content/blog/self-improving-agent-dgx-spark/index.md Outdated

@bilgeyucel bilgeyucel left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@bilgeyucel
bilgeyucel merged commit 8bf59c1 into main Oct 7, 2026
6 checks passed
@bilgeyucel
bilgeyucel deleted the blog/self-improving-agent-dgx-spark branch October 7, 2026 08:58

This branch was successfully deployed

1 active deployment
Preview — c2e8f6f6 Deployed Oct 7, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants