A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

Curated list of open source tooling for data-centric AI on unstructured data.

Programming assignments and quizzes from all courses within the GANs specialization offered by deeplearning.ai

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

a comprehensive statistical framework for detecting circular reasoning bias in AI algorithm evaluation

To help public defenders better serve their clients, Open Sentencing shows racial bias in data such as demographics providing insights for each case

Solutions on Practical Data Science Specialization on Coursera (offered by deeplearning.ai)

Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"

Learning to Split for Automatic Bias Detection

Tools for diagnostics and assessment of (machine learning) models

A curated list of Robust Machine Learning papers/articles and recent advancements.

Multi-Calibration & Multi-Accuracy Boosting for R

Code & Data for the paper "RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models"

This repository contains a console-interface name-ethnicity classifier

👚 Speedy Word Embedding Association Test & Extras using R

Perspective analyzes your news or social feed and presents credible counter-narratives from reliable sources—helping you think critically, reduce bias, and see the full picture. Don’t settle for one-sided stories. Get complete, nuanced facts.

"Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color" (ICCV 2023)

Structured pruning and bias visualization for Large Language Models. Tools for LLM optimization and fairness analysis.

HonestyMeter: An NLP-powered framework for evaluating objectivity and bias in media content, detecting manipulative techniques, and providing actionable feedback.