Content Standards for Data Matching and Record Linkage

Blog Administrator | Address Standardization, Analyzing Data, Data Management, Data Matching, Data Quality, Record Linkage | , , , , ,

By David Loshin

As I suggested in my last post, applying parsing and standardization to normalize data value structure will reduce complexity for exact matching. But what happens if there are errors in the values themselves?

Fortunately, the same methods of parsing and standardization can be used for the content itself. This can address the types of issues I noted in the first post of this series, in which someone entering data about me would have used a nickname such as “Dave” instead of “David.”

… Read More

Normalizing Structure Using Data Standardization for Improved Matching

Blog Administrator | Address Quality, Address Standardization, Analyzing Data, Data Matching, Data Quality, Record Linkage | , , , , , ,

By David Loshin

In my last few posts, I discussed how structural
differences impact the ability to search and match records across different
data sets. Fortunately, most data quality tool suites use integrated parsing
and standardization algorithms to map structures together.

As long as there is some standard representation, we should be able to come
up with a set of rules that can help to rearrange the words in a data value
to match that standard.

… Read More

Standardizing Your Approach to Monitoring the Quality of Data

Blog Administrator | Address Standardization, Analyzing Data, Data Cleansing, Data Integration, Data Management, Data Profiling, Data Quality | , , , , , , ,

By David Loshin

In my last post, I suggested three techniques for maturing your organizational approach to data quality management. The first recommendation was defining processes for evaluating errors when they are identified. These types of processes actually involve a few key techniques:

1) An approach to specifying data validity rules that can be
used to determine whether a data instance or record has an error.

… Read More

Modeling Issues and Entity Inheritance

Blog Administrator | Data Management, Data Quality, Fuzzy Matching, Record Linkage | , , , , , ,

By David Loshin

In our last set of posts, we looked at matching and record linkage and how approximate matching could be used to improve the organization’s view of “customer centricity.” Data quality tools such as parsing, standardization, and business-rule based record linkage and similarity scoring can help in assessing the similarity between two records. The result of the similarity analysis is a score that can be used to advise about the likelihood of two records referring to the same real-life individual or organization.
… Read More

Approximate Matching

Blog Administrator | Analyzing Data, Data Management, Data Quality, Duplicate Elimination, Record Linkage | , , , , ,

By David Loshin

Actually, my first name is not David – that is really my middle name, but it is the given name my parents used when talking to me. This has actually led to a lot of confusion over the years, especially when confronted with a form asking for me “first name” and my “last name.” For official forms (like my driver’s license) I use my real first name as my “first name,” but for non-official forms I often just use David.
… Read More