Tuesday, 4 February 2025

Beyond KPIs: The Role of Key Value Indicators (KVIs) in 6G

Key Performance Indicators (KPIs) have long been the primary benchmarks for evaluating mobile network performance. However, as 6G moves towards a broader societal and environmental impact, the European Hexa-X-II project and its partners advocate for integrating Key Values (KVs) and Key Value Indicators (KVIs) into network design and evaluation.

On 18 December 2024, Hexa-X-II hosted an insightful webinar to highlight the significance of KVIs in shaping the future of 6G. The session underscored how KVIs can complement KPIs by assessing technology’s impact on sustainability, digital inclusion, trust, and ethical considerations. 

While the video hasn't been shared, you can download the slides from here.

Why KVIs Matter in 6G Development

Traditionally, mobile network development has been driven by KPIs—throughput, latency, reliability, and spectrum efficiency. However, as 6G aims to support broader global goals such as the UN Sustainable Development Goals (SDGs), a shift towards value-based design is necessary. Hexa-X-II proposes a structured methodology where:

  • Human and Planetary Goals are identified (e.g., sustainability, digital inclusion, trust).
  • Key Values (KVs) are derived from these goals to reflect technology’s intended benefits and potential risks.
  • Key Value Indicators (KVIs) provide qualitative or quantitative measures to assess whether these values are met.

From Theory to Application: The Hexa-X-II Process

One of the core challenges in applying KVIs is the interdisciplinary nature of the assessment. Unlike KPIs, which are primarily technical, KVIs require social, economic, and environmental considerations. The Hexa-X-II approach includes:

  • Defining Use Case KVIs, which assess the impact of a specific application.
  • Defining Enabler KVIs, which measure how well a technical enabler (e.g., AI, NTN, RIS) contributes to key values.
  • Mapping KVIs to existing KPIs where possible and identifying gaps where new indicators are needed.
  • Iteratively refining KVIs based on real-world evaluations.

A Case Study: Cooperating Mobile Robots

One example discussed in the webinar was the use of cooperating mobile robots, a use case that benefits from 6G-enabled ultra-reliable low-latency communication (URLLC). While KPIs can measure performance (e.g., latency, reliability), KVIs help evaluate the broader impact, such as:

  • Environmental KVIs: Energy efficiency, material usage, electronic waste reduction.
  • Social KVIs: Job displacement vs. job creation, worker safety, accessibility.
  • Economic KVIs: Business viability, affordability, and risk of monopolisation.

By systematically assessing these factors, the Hexa-X-II framework ensures that 6G technology is not just high-performing but also aligned with societal needs.

Lessons Learned and Future Outlook

The adoption of KVIs presents several challenges, including subjective assessments, measurement difficulties, and the need for multi-stakeholder collaboration. However, Hexa-X-II emphasises that:

  • Technology impact should be continuously monitored using KVIs.
  • Qualitative and quantitative assessments must be combined, rather than relying solely on measurable KPIs.
  • A system-level approach is required, integrating perspectives from sustainability, business, and social sciences.

As 6G research advances, KVIs will play a crucial role in ensuring that next-generation networks contribute meaningfully to global sustainability and inclusivity. The Hexa-X-II initiative provides a foundational methodology for integrating values into the traditionally KPI-driven telecom landscape — an approach that could redefine how we measure success in the 6G era.

Related Posts

Friday, 17 January 2025

Lessons from ANRW ’24: AI and Cloud in 5G/6G Systems

The ACM, IRTF & ISOC Applied Networking Research Workshops (ANRW) offer a vibrant forum for researchers, vendors, network operators, and the Internet standards community to exchange emerging results in applied networking research. To foster collaboration across these diverse groups, ANRW events are co-located with IETF standards meetings, typically held annually in July. These workshops prioritise interactive discussions and engagement, complementing traditional paper presentations.

ANRW '24, held on 23 July 2024 at the Hyatt Regency Vancouver, brought together industry leaders and academics to share insights on advancing networking technologies. Among the standout sessions was a keynote presentation by Sharad Agarwal, Senior Principal Researcher at Microsoft. His keynote titled, "Lessons I Learned in Leveraging AI+ML for 5G/6G Systems", highlighted pivotal themes influencing telecom and networking.

Sharad distilled his experiences into three key lessons, each underscored by examples of research and systems developed to address specific challenges in the telecom industry:

  1. Leverage Cloud Scale to Overcome Limitations of Deployed Protocols: He emphasised that the scale of cloud computing is critical to managing the massive demands of modern telecom networks. For instance, systems like TIPSY (Traffic Ingress Prediction SYstem) demonstrate how AI and ML can predict traffic ingress points across thousands of peering links, helping to avoid bottlenecks and ensure optimal traffic distribution.
  2. Custom Learning Algorithms vs. Off-the-Shelf Solutions: While bespoke algorithms offer higher precision for niche applications, their complexity and deployment challenges often outweigh their benefits. Sharad argued for balancing innovation with practicality, advocating for leveraging pre-built AI and ML models wherever possible to streamline integration.
  3. Mitigate Risks of AI Hallucinations through Careful System Design: Acknowledging the risks posed by unreliable AI outputs, he stressed the importance of robust system design. Using LLexus, an AI-driven incident management system, as an example, Sharad highlighted techniques like iterative plan generation, validation rules, and human auditing as essential safeguards against AI errors.

The talk also delved into broader trends shaping the telecom landscape:

  • Cloudification of Telecom Infrastructure: The shift from hardware-based to software-based network functions, underpinned by cloud-native principles, has revolutionised telco infrastructure. This transformation facilitates rapid upgrades, reduces costs, and introduces new opportunities for AI-driven analytics.
  • Challenges in Performance and Reliability: Ensuring high throughput, low latency, and carrier-grade reliability in cloudified networks remains a significant hurdle. Innovations like PAINTER and LLexus demonstrate how AI and ML are being applied to optimise these aspects.
  • Emerging Business Models and Private Deployments: The integration of new radio technologies and virtualised network functions is driving novel revenue streams, such as private 5G/6G networks for mission-critical applications like factory automation.
Finally, Sharad’s keynote underscored how AI, ML, and cloud computing are reshaping the telecom industry, particularly in the era of 5G and the forthcoming 6G. By leveraging the scale of cloud infrastructure, balancing algorithmic complexity, and designing systems with resilience against AI pitfalls, the industry is poised to meet its ambitious goals of high bandwidth, low latency, and unparalleled reliability.

The video of his talk is embedded below and the slides are available here:

Related Posts: