Bullish predictions suggest that artificial intelligence (AI) could contribute up to $15.7 trillion to the global economy by 2030. From autonomous cars to faster mortgage approvals and automated advertising decisions, AI algorithms promise numerous benefits for businesses and their customers.
Unfortunately, these benefits may not be enjoyed equally. Algorithmic bias — when algorithms produce discriminatory outcomes against certain categories of individuals, typically minorities and women — may also worsen existing social inequalities, particularly when it comes to race and gender. From the recidivism prediction algorithm used in courts to the medical care prediction algorithm used by hospitals, studies have found evidence of algorithmic biases that make racial disparities worse for those impacted, not better.
Many firms have put considerable effort into combating algorithmic bias in their management and services. They often use data-science driven approaches to investigate what an algorithm’s predictions will be before launching it into the world. This can include examining different AI model specifications, specifying the objective function that the model should minimize, selecting the input data to be seeded into the model, pre-processing the data, and making post-processing model predictions.
However, the final outcome of deploying an algorithm relies on not only the algorithm predictions, but also how it will ultimately be used by business and customers — and this critical context of receptivity and adoption of algorithm is often overlooked. We argue that algorithm deployment must consider the market conditions under which the algorithm is used. Such market conditions may affect what/who, and to what extent the algorithm’s decisions will impact, and hence influence the realized benefits for users of using the algorithm.
For example, to help its hosts maximize their income (i.e., property revenue), Airbnb launched an AI algorithm-based smart pricing tool that automatically adjusts a listing’s daily price. Airbnb hosts have very limited information on competing Airbnb properties, hotel rates, seasonality, and various other demand shocks that they can use to correctly price their properties. The smart pricing algorithm was meant to help with this, incorporating relevant information on host, property, and neighborhood characteristics from the company’s enormous information sources to determine the best price for a property. In our recently published study, the average daily revenue of hosts who adopted smart pricing increased by 8.6%. Nevertheless, after the launch of the algorithm, the racial revenue gap increased (i.e., white hosts earned more) at the population level, which includes both adopters and non-adopters, because Black hosts were significantly less likely to adopt the algorithm than white hosts were. READ MORE
by Shunyuan Zhang, Kannan Srinivasan, Param Vir Singh, and Nitin Mehta
In the wake of George Floyd’s murder, corporate interest in DEI is higher than ever. But has this increased attention racial justice and inequity led to real, meaningful change? The authors conducted interviews with more than 40 CDOs before and after summer 2020 and identified four major shifts in how these leaders perceived their companies’ engagement with DEI.
Mid-career women are often surprised by the levels of bias and discrimination they encounter in the workplace, especially if they’ve successfully avoided it earlier in their careers. After speaking to 100 senior women executives, the authors identified three distinct kinds of bias and discrimination faced by mid-career women. They describe each bias and conclude with recommendations for overcoming them.
Bain research shows that men and women have consistent motivations when it comes to work, across factors like financial orientation and camaraderie. They also have similar attitudes on inclusion, with fewer than 30% feeling included in the workplace. Despite a lack of intrinsic differences, women and men continue to have different outcomes and experiences at work, due to meaningful imbalances in occupation choice, prioritization of flexibility, and the perpetuation of biases.