The Risks of Relying on Machine Learning for Search Results

Alex Manhooei
2 min readJan 17, 2023

When we search for something online, we expect the search engine to return a list of recommended websites and resources that match our query. This allows us to select the information that we find most useful. However, with the emergence of machine learning (ML) answers like ChatGPT, we are presented with a single response to a search. This means that the ML algorithms decide what information we receive based on who controls the ML or our previous usage patterns.

The Risk of Manipulation

This poses a significant issue when it comes to the reliability and impartiality of the information we receive. If the ML algorithms are controlled by a single entity, there is a risk that the information provided can be manipulated to align with their agenda. For example, if a political party controls the ML algorithm, they could use it to promote their own agenda and shape the public’s perception of certain issues.

The Filter Bubble

Similarly, if the ML algorithm is based on our previous usage patterns, it can create a filter bubble, where we are only presented with information that confirms our existing beliefs and biases. This can lead to a lack of exposure to diverse perspectives and can reinforce existing stereotypes and prejudices.

Mitigating the Risks

To mitigate these risks, it’s essential that the development and deployment of ML algorithms are done in a transparent and responsible manner. This includes ensuring that the algorithms are trained on a diverse and representative dataset, and that there are mechanisms in place to detect and correct any biases in the algorithm’s output. Additionally, it’s crucial that the users are aware of the limitations and potential biases of the ML responses and encouraged to seek out alternative sources of information.

Conclusion

In conclusion, while ML algorithms can provide us with quick and accurate responses to our search queries, it’s important to be aware of the potential risks they pose when it comes to the impartiality and reliability of the information we receive. It’s crucial that we work towards ensuring the development and deployment of ML algorithms are done in a transparent and responsible manner, to ensure that we can trust the information we receive.

Disclaimer: I work for google but this blog is based on my complete personal opinion.

--

--

Alex Manhooei

Staff Software Engineer @ Google. All of my blog posts are my personal opinions and not related to my work at google in any shape or form.