Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings
@Responsible-AI-Labs

Responsible AI Labs

Deep-tech AI startup making AI safer and more accountable. RAIL Score: SDKs, hosted MCP server, guardrails, red-teaming, India DPDP and EU AI Act compliance.

Responsible AI Labs

Deep-tech for responsible AI.
We build developer tools, publish open research, and shape AI governance — with a first-class focus on India's regulatory landscape. LLM safety, compliance (GDPR, EU AI Act, India DPDP, HIPAA), red-teaming, and safe regeneration.

PyPI versionPyPI total downloads npm versionnpm total downloads Drupal MCP Server arXiv HuggingFace License

Website · Docs · PyPI · npm · MCP Server · Discussions

If our work helps you ship safer AI, a star on rail-score-sdk keeps the roadmap funded.


About Responsible AI Labs

A deep-tech AI startup making artificial intelligence safer and more accountable. We operate across three fronts:

Products RAIL Score — an API, SDKs (Python, JavaScript, Drupal), and a hosted MCP server for LLM evaluation, guardrails, compliance, and red-teaming
Open Research Peer-reviewable methodology on arXiv and public datasets on Hugging Face — the RAIL Guard Benchmark, RAIL-HH-10K, and the Indian Responsible AI Benchmark
Governance & policy Native support for India DPDP Act and India AI Governance alongside GDPR, HIPAA, EU AI Act, and CCPA — the only evaluation platform in which India-specific frameworks are first-class

Built in India, built for everywhere. Reach us at responsibleailabs.ai.


RAIL Score — our flagship platform

RAIL Score is an API-first platform that evaluates AI-generated content across 8 independent dimensions on a 0-10 scale:

Fairness · Safety · Reliability · Transparency · Privacy · Accountability · Inclusivity · User Impact

Each evaluation returns per-dimension scores, confidence levels, issue detection, and actionable improvement suggestions. Not a single opaque number — a full diagnostic.

Built for teams shipping production LLM applications who need measurable, auditable safety, guardrails, and regulatory compliance inside their existing stack: drop-in provider wrappers, middleware, policy thresholds, multi-turn sessions, agent tool-call evaluation, prompt-injection detection, and single-call compliance across GDPR, HIPAA, EU AI Act, CCPA, India DPDP, and India AI Governance.

How it flows

flowchart LR
    App["Your App / SDK"] --> RAIL["RAIL Score API"]
    MCP["MCP Client<br/>Claude · Cursor · Copilot"] --> RAIL
    RAIL --> Eval["Evaluate<br/>8 dimensions"]
    RAIL --> Comp["Compliance<br/>GDPR · HIPAA · EU AI Act<br/>DPDP · CCPA · India AI Gov"]
    RAIL --> RT["Red-team<br/>prompt injection · agent eval"]
    Eval --> Gate{thresholds met?}
    Comp --> Gate
    RT --> Gate
    Gate -- yes --> Pass["✓ Ship to user"]
    Gate -- no --> Regen["Safe-regenerate<br/>evaluate → improve → retry"]
    Regen --> Eval
    classDef brand fill:#75BFAF,stroke:#2D6B5A,color:#0A2A22;
    class RAIL brand;
Loading

Core capabilities

Evaluation — Score any AI output with basic (~1 credit) or deep (~3 credits) analysis, with custom dimension weights for healthcare, finance, legal, and general contexts.

Safe Regeneration — Evaluate → improve → regenerate loop that runs until your thresholds are met. Server-side or client-side with your own LLM.

Compliance Testing — 63 requirements across 6 frameworks: GDPR, HIPAA, EU AI Act, CCPA, India DPDP Act, India AI Governance. Single API call.

Agent Evaluation — Tool call evaluation (ALLOW/FLAG/BLOCK), tool result scanning with PII redaction, and prompt injection detection across 5 attack patterns.

MCP Server: A hosted Model Context Protocol endpoint that adds the full RAIL safety layer to any MCP client (Claude, ChatGPT, Cursor, Copilot, Replit Agent, LangGraph, CrewAI) through a single URL, with no SDK integration. Exposes 8-dimension evaluation, agent tool-call gating, PII scanning, and India DPDP compliance.

Policy Engine & MiddlewareRAILMiddleware wraps any generate function. PolicyEngine enforces per-dimension thresholds. RAILSession tracks multi-turn risk.

Configuration & Monitoring — Read the application's governance policy, plan capabilities, and dimension settings at runtime (get_config, get_capabilities, get_dimensions) for startup checks and observability.

LLM Observability — Native integration with Langfuse scores, LiteLLM guardrails, OpenAI, Anthropic, and Gemini.


Packages

Package Registry Install
Python SDK PyPI versionPyPI downloads pip install rail-score-sdk
JavaScript/TypeScript SDK npm versionnpm downloads npm install @responsible-ai-labs/rail-score
Drupal Module Drupal composer require drupal/rail_score
MCP Server MCP https://mcp.responsibleailabs.ai/mcp

Provider extras (Python)

pip install rail-score-sdk[openai]       # GPT-4o, GPT-4o-mini
pip install rail-score-sdk[anthropic]    # Claude 3.5, Claude 3
pip install rail-score-sdk[google]       # Gemini 1.5 Pro/Flash
pip install rail-score-sdk[litellm]      # LiteLLM guardrail support
pip install rail-score-sdk[integrations] # All providers

Quick start

Python

from rail_score_sdk import RAILClient

client = RAILClient(api_key="your-api-key")

result = client.evaluate(
    content="Your AI-generated text here",
    mode="deep",
    domain="healthcare"
)

for dim in result.dimensions:
    print(f"{dim.name}: {dim.score}/10 (confidence: {dim.confidence})")

JavaScript / TypeScript

import { RAILClient } from '@responsible-ai-labs/rail-score';

const client = new RAILClient({ apiKey: 'your-api-key' });

const result = await client.evaluate({
  content: 'Your AI-generated text here',
  mode: 'deep',
  domain: 'healthcare'
});

result.dimensions.forEach(dim => {
  console.log(`${dim.name}: ${dim.score}/10`);
});

LLM wrappers (drop-in replacements)

from rail_score_sdk.wrappers import RAILOpenAI

client = RAILOpenAI(api_key="your-api-key", openai_api_key="sk-...")
# Every response is automatically scored
response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "Summarize this report"}]
)
print(response.rail_score)  # Full 8-dimension evaluation attached

Compliance coverage

RAIL Score tests 63 requirements across 6 regulatory frameworks in a single API call:

Framework Requirements Status
GDPR 12 Supported
HIPAA 11 Supported
EU AI Act 14 Supported
CCPA 8 Supported
India DPDP Act 9 Supported
India AI Governance 9 Supported

RAIL Score is the only evaluation platform where India DPDP Act and India AI Governance are native, first-class compliance frameworks alongside GDPR, HIPAA, EU AI Act, and CCPA.


Why RAIL Score

  • India-first compliance, globally competitive — DPDP Act and India AI Governance ship as native frameworks, not bolted-on add-ons
  • Full diagnostic, not a single score — eight independent dimensions, each with confidence, issues, and suggestions
  • Closed-loop, not read-only — safe regeneration, policy enforcement, and session-level risk tracking, not just measurement
  • Fits where developers already work — drop-in wrappers for OpenAI, Anthropic, Gemini, LiteLLM, and Langfuse; middleware for any generate function
  • Grounded in research — peer-reviewable methodology on arXiv (2505.00204) and three public benchmarks on HuggingFace, including the RAIL Guard Benchmark for LLM and agent safety

Datasets & Research

Resource Description
RAIL Guard Benchmark 1,589 examples for continuous LLM safety evaluation — 1,197 content prompts across 6 domains (benign / edge / adversarial) and 392 agent tool-call scenarios across 5 domains, scored on all 8 RAIL dimensions
RAIL-HH-10K 10,000 examples with 73 columns of 8-dimension scoring, built on Anthropic's HH dataset
Indian Responsible AI Benchmark 212 adversarial prompts across 22 India-specific categories (caste bias, regional sensitivity, linguistic nuance)
arXiv 2505.00204 "RAIL in the Wild: Operationalizing Responsible AI Evaluation Using Anthropic's Value Dataset"

Repositories

Repo What it's for
rail-score-sdk Python SDK — sync/async client, middleware, batch, sessions, agent eval
rail-score-js JavaScript/TypeScript SDK — wrappers, middleware, policy engine, sessions
rail-score-mcp Hosted MCP server: one-URL safety layer for any MCP client, no SDK required
rail-score-drupal Drupal CMS integration module

Community & support

  • Questions, feature requests, how-to threadsGitHub Discussions
  • Bugs and reproducible issuesopen an issue
  • Contributing — see CONTRIBUTING.md; issues labelled good first issue are the easiest starting points
  • Security disclosures — see each repo's SECURITY.md

Links

Website responsibleailabs.ai
Documentation docs.responsibleailabs.ai
Knowledge Hub responsibleailabs.ai/knowledge-hub
PyPI pypi.org/project/rail-score-sdk
npm npmjs.com/package/@responsible-ai-labs/rail-score
MCP Server mcp.responsibleailabs.ai/mcp
HuggingFace huggingface.co/responsible-ai-labs
arXiv arxiv.org/abs/2505.00204
X @RAILabsIndia
LinkedIn company/rail-ai

RAIL  ·  Responsible AI Labs Pvt. Ltd.  ·  Built in India, built for everywhere.

Pinned Loading

  1. rail-score-js rail-score-js Public

    Official JavaScript and TypeScript SDK for RAIL Score. Type-safe LLM evaluation across 8 dimensions, guardrails, policy engine, safe regeneration, and multi-framework compliance.

    TypeScript 10 1

Repositories

Loading
Type
Select type
Language
Select language
Sort
Select order
Showing 5 of 5 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…

Morty Proxy This is a proxified and sanitized view of the page, visit original site.