The future of human agency in a world of advanced AI

The rapid development of artificial intelligence (AI) and smart digital systems has raised important questions about the future of human agency and decision-making. A recent canvassing of 540 technology experts by Pew Research Center found that 56% believe that by 2035, smart machines and AI systems will not be designed to allow humans to easily be in control of most tech-aided decision-making. The remaining 44% were more optimistic that humans would retain agency.

At the core of this issue is the concept of self-determination - a person's ability to make choices and manage their own life. Self-determination theory suggests that people are motivated to grow and change by three innate psychological needs: autonomy, competence, and connection. In order to promote psychological health and well-being, it is important for people to feel a sense of control over their behaviors and goals.

As AI systems become more advanced and ubiquitous, there are valid concerns that they could undermine human autonomy if not properly designed and regulated. Some experts warn about the risks of exploitative powers using AI to manipulate people's choices and behaviors. One respondent to the Pew canvassing said, "The public will not be in control; it will be the owners of the most-capable systems making decisions for the masses."

However, others believe that with the right safeguards in place, AI can be a powerful tool for enhancing rather than diminishing human agency. They argue that laws and standards can be established to ensure AI systems prioritise human oversight, transparency, fairness and accountability. As one optimistic expert put it, "By 2035 we will have more automation of routine activities, but humans will still be directly inputting into and controlling non-routine and more complex activities."

The key may be developing AI systems that augment and assist human decision-making rather than fully automating it. For example, in military applications, AI could be used to enhance warfighters' cognitive performance on the battlefield, but extensive research and human experimentation is needed to mitigate risks to "cognitive liberty, psychological and physiological health." In other domains like health care, AI diagnostic tools could provide more accurate and timely analysis, but still allow doctors to easily override the AI when needed based on their expertise and judgment.

Ultimately, the future of human agency in an AI-driven world will depend on the values and priorities we embed into these systems as we design and deploy them. We must proactively put in place the oversight mechanisms and human-centric development processes to ensure that AI empowers rather than erodes our self-determination and ability to make meaningful choices about our lives. With the proper stewardship, AI could expand the scope of human agency, but without it, we risk ceding ever more control to the machines.

Consider these strategic insights:

  • Develop AI-assisted decision support tools: Create AI systems that augment human decision-making in key business areas like marketing, operations, and customer service, while ensuring human oversight and control.
  • Establish an AI ethics board: Form a diverse group of stakeholders to guide the development and deployment of AI systems in your business, ensuring they align with human values and prioritise transparency, fairness, and accountability.
  • Invest in AI literacy training: Provide education and training programs to help employees understand the capabilities and limitations of AI, empowering them to work effectively alongside these systems while maintaining their autonomy and judgment.
  • Advocate for AI governance frameworks: Engage with policymakers, industry associations, and other stakeholders to shape the development of laws, standards, and best practices that protect human agency in the use of AI systems.

Signals from the future:

Emerging trends that are likely to drive changes to the way we live, work and do business.

Technology

Society

Health & Wellbeing

Climate & Energy

Deep strategy:

Longer form articles rich with insights:

  • Don’t Sacrifice Employee Upskilling for Productivity - MIT Sloan Management Review - Prioritising employee development over strict productivity tracking leads to greater long-term success and productivity in organisations.
  • What Sets Genius Teams Apart - Harvard Business Review - Unlocking the potential of executive teams through raw capacity, ambitious goals, and productive tension for sustained success and innovation.

Business at the point of impact:

Emerging issues and technology trends can change the way we work and do business.

Portage logo
Ready to apply futures thinking and strategic foresight to your biggest challenges? Introducing a strategy design platform that brings over 150 trends, scenario generation, visual strategy boards, combined with finely tuned AI assistants to help guide you through the process.
Read more like this
Build your futures thinking capabilities

More insights: