惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

J
Java Code Geeks
I
InfoQ
阮一峰的网络日志
阮一峰的网络日志
有赞技术团队
有赞技术团队
Vercel News
Vercel News
Engineering at Meta
Engineering at Meta
Hugging Face - Blog
Hugging Face - Blog
G
Google Developers Blog
Stack Overflow Blog
Stack Overflow Blog
aimingoo的专栏
aimingoo的专栏
罗磊的独立博客
Blog — PlanetScale
Blog — PlanetScale
Microsoft Security Blog
Microsoft Security Blog
B
Blog RSS Feed
H
Help Net Security
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
P
Proofpoint News Feed
MyScale Blog
MyScale Blog
V
Visual Studio Blog
B
Blog
MongoDB | Blog
MongoDB | Blog
T
The Blog of Author Tim Ferriss
L
LangChain Blog
D
Docker

Latest blog posts

Using Snowflake for External Data Deployment | Demyst 5 Hurdles Facing New Financial Products | Demyst The What, Why, and How of External Data | Demyst Fast Company Recognizes How External Data Can Change the World | Demyst 5 Checks for Flagging Fraud Risk | Demyst External Data’s Tipping Point | Demyst OpenCorporates Spotlight: Data Transparency Deep Dive | Demyst Vendor Due Diligence for Data Privacy | Demyst Looking Ahead: High Expectations, Low Margins for Error | Demyst How Lenders and Insurers Can Use Geolocation Data | Demyst Assessing Driver Risk Without Using Credit Scores | Demyst Digital Footprints for ID Verification | Demyst Layered Solutions to Fight SMB Lending Fraud | Demyst Global IDV Workflows Demand Multi-Source Solutions | Demyst Fintechs: Drifting into Compliance Failure? | Demyst Penalties Mount for Marketers Using Toxic Data | Demyst Assess Insurance Risk with Property Data | Demyst Application Prefill: A Digital Reality | Demyst Demand for ESG Data is Accelerating | Demyst Demyst’s Entity Resolution: Multi-Source Recipes | Demyst Verifying Phone Numbers Is Key for the BNPL Vertical | Demyst Game Changer: Demyst’s Entity Resolution Tech | Demyst Social Inflation Raises Courtroom Risks | Demyst Expecting the Unexpected | Demyst Meet Demyst at AWS re:Invent 2021 | Demyst External Data Addresses Crypto Regulations | Demyst Supply Chain Risk Management | Demyst Collaboration with AWS Data Exchange | Demyst Improving Trust on Managed Platforms | Demyst Risk Management: Diving Deeper | Demyst
Finding Solutions for Data Bias | Demyst
The Demyst Team · 2022-07-23 · via Latest blog posts

Data scientists, software engineers, and other experts are creating business solutions that rely on algorithms, automated decision-making tools, artificial intelligence (AI), and machine learning models. Their work has developed faster, more efficient business processes, but it has also raised some concerns. 

Regulators and consumers expect companies to demonstrate how they have mitigated bias and discriminatory decisions in their advanced decision-making models. Enterprises will need to explain how their work attempts to minimize these risks.

Data itself is neither good nor evil

In some models, data points like age or gender might be defined as “bad” and excluded to avoid biased outcomes. In other models, the same data points could be defined as “good” and integrated to produce unbiased outcomes. This ambiguity has been the source of public criticism, and faulty assumptions expose enterprises to serious consequences.

The advanced application of data offers a mix of threats and opportunities. Models and algorithms can reduce human error by interpreting data objectively, but they can also deploy human and societal biases at scale. In these cases, it is frequently the underlying data, not the algorithms themselves, that cause problems. 

Biased data not only presents risks to consumers, but also to the companies that serve them. Flawed pricing models can lead to financial losses, and regulators like the US Federal Trade Commission have warned that companies will face regulatory action if they fail to hold themselves accountable for the fairness of their algorithms. 

However, organizations can integrate clean, equitable, and actively monitored external data into their workflows to improve digital onboarding, online fraud prevention, and credit decisioning processes — in addition to reducing model bias — to meet regulatory needs and customer concerns. 

Discernment and Expertise

Market-leading enterprises overcome the limits of their own internal data by working with external data products. The key is to select expert partners who curate high-quality data that is relevant, cost-effective, and as close to real-time as possible.

Organizations like FinRegLab are exploring how external data can be applied to credit underwriting decisions. CGAP is researching emerging business models to determine which business models have the clearest links to financial inclusion. And Demyst has worked with TruEra to develop a solution for mitigating bias in AI-based credit decisioning models.


Enterprises that commit to making a difference have seen instant value with immediate positive results. At the core level, these organizations are working with unbiased data and minimizing distortions so that their models account for a broader, more diverse population. The effective integration of external data is a key driver of digital transformation and external data platforms such as Demyst continue to work in partnership with innovative enterprises to help to make that difference.