Skip to content

chatbot.md

Latest commit

 

History

History
104 lines (67 loc) · 5.55 KB

chatbot.md

File metadata and controls

104 lines (67 loc) · 5.55 KB
Raw

Overview

The X-AnyLabeling Chatbot is an AI assistant integrated into the annotation workflow. It supports natural-language conversations, batch image-question answering, and importing or exporting single-turn and multi-turn multimodal data in ShareGPT format for frameworks such as LLaMA-Factory.

open_chatbot_and_chat.mp4

Getting Started

Accessing the Chatbot

To open the Chatbot, click the Chatbot icon in the left toolbar of X-AnyLabeling or use the following keyboard shortcut to quickly launch the Chatbot interface:

  • Windows/Linux: Ctrl + 1
  • macOS: ⌘ + 1

Initial Setup

On the first launch, you need to configure the necessary API credentials and models in the right panel of the Chatbot window.

User Interface

The Chatbot features a three-panel interface designed for streamlined interaction.

select_model.mp4

Left Panel - Model Providers

Provider API Key API Docs Model Docs
Anthropic Link Link Link
DeepSeek Link Link Link
Google AI Link Link Link
Ollama - Link Link
OpenAI Link Link Link
OpenRouter Link Link Link
Qwen Link Link Link

Note

The Custom provider supports configuring any custom endpoint that is compatible with the OpenAI API format. Enter the model name manually when using Custom; other providers list the available models for selection.

Middle Panel - Chat Interface

  • Chat Window: View your conversation history with the AI. Supports copy, edit, delete, and rerun functions.
  • Message Input: Enter your questions or instructions. Includes a one-click option to clear the current conversation history.
  • Special Command: After importing an image, use the @image prompt to include the current image in your query.

Right Panel - Image Preview and Settings

  • Image Preview: Displays the current image.
  • Function Components:
    • Image Navigation: Switch between the previous and next images.
    • Image Import: Import a single image file or an entire directory.
    • Data Export: Export annotation results.
    • Batch Processing: Run processing tasks on multiple images.
  • Backend Settings: Configure API endpoints, keys, and select models.
  • Generation Parameters: Input system prompts, temperature settings, and maximum output length.

Key Features

Visual Question Answering (VQA)

import_image_folder.mp4

Ask questions about the current image to efficiently generate single-turn or multi-turn image-text dialogues:

@image Please describe this image.

Batch Image Processing

batch_run.mp4

Process multiple images with the same prompt to speed up your workflow:

  1. Load an image folder.
  2. Click the "Run All Images" button.
  3. Enter the prompt to apply to all images.
  4. You can set the concurrency level to control processing speed (default is 80% of CPU cores, maximum is 95%).

Dataset Import/Export

export_sharegpt.mp4

Supports one-click export of multimodal image data in the ShareGPT format.

Other

Configuration Files

The Chatbot stores its configuration in the following directory:

~/xanylabeling_data/chatbot/

This directory contains:

  • models.json: Contains user preferences and model configurations.
  • providers.json: API provider settings.