Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
Scalable master data management, identity resolution, entity resolution, and deduplication using ML
A powerful and modular toolkit for record linkage and duplicate detection in Python
1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.
On-device Speech-to-Intent engine powered by deep learning
🆔 Command line tool for deduplicating CSV files
🆔 Examples for using the dedupe library
A list of free data matching and record linkage software.
Recent trends of Entity Linking, Disambiguation, and Representation.
This repository contains code and datasets related to entity/knowledge papers from the VERT (Versatile Entity Recognition & disambiguation Toolkit) project, by the Knowledge Computing group at Microsoft Research Asia (MSRA).
ReFinED is an efficient and accurate entity linking (EL) system.
Strwythura: construct an entity-resolved knowledge graph from structured data sources and unstructured content sources, implementing an ontology pipeline, plus context engineering for optimizing AI application outcomes within a specific domain. This produces a Streamlit app, with MLOps instrumentation.
An open source, high scalability toolkit in Java for Entity Resolution.
🔎 Finds fuzzy matches between CSV files
Entity resolution for Elasticsearch.
PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.
A convenient way to link, deduplicate, aggregate and cluster data(frames) in Python using deep learning
List of entity resolution software and resources.
OpenRefine reconciliation services for VIAF, ORCID, and Open Library + framework for creating more.
Created by Halbert L. Dunn
Released 1946