typescript-sdk — evaluation typescript-sdk, community, evaluation, ide skills, hacktoberfest, hacktoberfest2025, langchain, llama-index, llm-evaluation, llm-observability, Claude Code

v1.0.0
GitHub

About this Skill

Ideal for Advanced AI Agents requiring comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications and RAG systems Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

# Core Topics

comet-ml comet-ml
[17.8k]
[1358]
Updated: 2/26/2026

Agent Capability Analysis

The typescript-sdk skill by comet-ml is an open-source community AI agent skill for Claude Code and other IDE workflows, helping agents execute tasks with better context, repeatability, and domain-specific guidance. Optimized for evaluation, hacktoberfest, hacktoberfest2025.

Ideal Agent Persona

Ideal for Advanced AI Agents requiring comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications and RAG systems

Core Value

Empowers agents to debug, evaluate, and monitor applications with layered, non-blocking architecture, utilizing Node >= 18, ESM + CJS builds, and async data buffering to backend via REST Client, enhancing overall system reliability and performance with OpikClient and Domain tracing

Capabilities Granted for typescript-sdk

Debugging LLM applications with comprehensive tracing
Evaluating RAG systems with automated evaluations
Monitoring agentic workflows with production-ready dashboards

! Prerequisites & Limits

  • Requires Node version 18 or higher
  • Needs updates and verification of version references in README.md when changing dependencies or minimum versions
Labs Demo

Browser Sandbox Environment

⚡️ Ready to unleash?

Experience this Agent in a zero-setup browser environment powered by WebContainers. No installation required.

Boot Container Sandbox

typescript-sdk

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and...

SKILL.md
Readonly

TypeScript SDK

Architecture

  • Layered, non-blocking by default
  • Data buffered and flushed async to backend
  • Node >= 18, ESM + CJS builds

Layer Flow

Public API → OpikClient → Domain (Trace/Span) → BatchQueues → REST Client → Backend

Critical Gotchas

  • When changing dependencies or minimum versions, update and verify version references in README.md and integration README files in the same PR.

Flush Before Exit

typescript
1// ✅ REQUIRED - especially in CLI/tests 2await client.flush(); 3// or globally: 4await flushAll();

Domain Objects Don't Do HTTP

typescript
1// ✅ GOOD - domain objects enqueue, not HTTP 2trace.update({ metadata: { key: 'value' } }); // Enqueues update 3trace.end(); // Enqueues update 4 5// ❌ BAD - don't call REST directly from domain

Never Leak rest_api

typescript
1// ✅ GOOD - export from public API 2export { Opik, track, flushAll } from 'opik'; 3 4// ❌ BAD - don't expose generated clients 5import { TracesApi } from 'opik/rest_api'; // Internal!

Batching Semantics

  • Updates wait for pending creates
  • Deletes wait for creates and updates
  • flush() flushes all queues in order
  • Debounce window configurable via OpikConfig

Error Handling

  • HTTP failures: OpikApiError, OpikApiTimeoutError
  • 404s translate to domain errors: DatasetNotFoundError, ExperimentNotFoundError
  • Never swallow errors, include context in logs

Integration Guidelines

  • Integrations wrap public API only
  • Keep adapters thin, non-blocking
  • Provide flush() escape hatch if needed

Reference Files

  • testing.md - Vitest patterns, mocking, flush timing

FAQ & Installation Steps

These questions and steps mirror the structured data on this page for better search understanding.

? Frequently Asked Questions

What is typescript-sdk?

Ideal for Advanced AI Agents requiring comprehensive tracing, automated evaluations, and production-ready dashboards for LLM applications and RAG systems Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

How do I install typescript-sdk?

Run the command: npx killer-skills add comet-ml/opik. It works with Cursor, Windsurf, VS Code, Claude Code, and 19+ other IDEs.

What are the use cases for typescript-sdk?

Key use cases include: Debugging LLM applications with comprehensive tracing, Evaluating RAG systems with automated evaluations, Monitoring agentic workflows with production-ready dashboards.

Which IDEs are compatible with typescript-sdk?

This skill is compatible with Cursor, Windsurf, VS Code, Trae, Claude Code, OpenClaw, Aider, Codex, OpenCode, Goose, Cline, Roo Code, Kiro, Augment Code, Continue, GitHub Copilot, Sourcegraph Cody, and Amazon Q Developer. Use the Killer-Skills CLI for universal one-command installation.

Are there any limitations for typescript-sdk?

Requires Node version 18 or higher. Needs updates and verification of version references in README.md when changing dependencies or minimum versions.

How To Install

  1. 1. Open your terminal

    Open the terminal or command line in your project directory.

  2. 2. Run the install command

    Run: npx killer-skills add comet-ml/opik. The CLI will automatically detect your IDE or AI agent and configure the skill.

  3. 3. Start using the skill

    The skill is now active. Your AI agent can use typescript-sdk immediately in the current project.

Related Skills

Looking for an alternative to typescript-sdk or another community skill for your workflow? Explore these related open-source skills.

View All

widget-generator

Logo of f
f

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.

149.6k
0
AI

flags

Logo of vercel
vercel

flags is a Next.js feature management skill that enables developers to efficiently add or modify framework feature flags, streamlining React application development.

138.4k
0
Browser

zustand

Logo of lobehub
lobehub

The ultimate space for work and life — to find, build, and collaborate with agent teammates that grow with you. We are taking agent harness to the next level — enabling multi-agent collaboration, effortless agent team design, and introducing agents as the unit of work interaction.

72.8k
0
AI

data-fetching

Logo of lobehub
lobehub

The ultimate space for work and life — to find, build, and collaborate with agent teammates that grow with you. We are taking agent harness to the next level — enabling multi-agent collaboration, effortless agent team design, and introducing agents as the unit of work interaction.

72.8k
0
AI