• Insights
    • Webinars
    • Blog
    • Perspectives
    • Toolboxes
    • Events
    • Awards
  • Offering
    • Academy
      • Innovation courses
      • Innovation programs
    • Consulting
      • Onsite consultants
      • Project management
    • Services
      • Scout it
        • Business & strategy
        • Technology management
      • Invent it
        • Proposition management
        • Feasibility & IP development
      • Create it
        • Strategic design
        • Demonstrators & prototypes
      • Scale it
        • Go-to-market
        • Industrialization & production
    • Funding
      • Innovation grants
      • Seed capital
      • Subsidy applications
    • Solutions
      • MyStartUp
      • MyStartUp Portfolio
      • MyInnovationFactory
      • MyInnovationTalent
      • MyFutureProduct
  • Markets
    • Smart Space & Security
    • Smart FMCG
    • Smart Life Sciences
    • Smart Industry
  • Capabilities
    • Strategic Innovation
      • OpenLab
      • DesignLab
      • InnoLab
    • Digital innovation
      • AILab
      • DigitalLab
      • EmbeddedLab
    • Product innovation
      • MechLab
      • PhysicsLab
      • FabLab
    • High-tech innovation
      • OpticsLab
  • Technologies
    • Technology portfolio
    • IoT & sensors
    • AI & data science
    • Robotics & autonomy
    • Cooling, heating & fluidics
  • About
    • Our story
    • News
  • Jobs
  • Contact
Verhaert Masters in InnovationVerhaert Masters in Innovation
Verhaert Masters in InnovationVerhaert Masters in Innovation
  • Insights
        • Insights

        • Perspectives
        • Blog
        • Webinars
        • Toolboxes
        • Awards
  • Offering
        • Services

        • Consulting

        • Academy

        • Funding

        • Solutions

        • Scout it
          • Business & strategy
          • Technology management
        • Invent it
          • Proposition management
          • IP management & feasibility
        • Create it
          • Strategic design
          • Demonstrators & prototypes
        • Scale it
          • Go-to-market
          • Industrialization & production
        • Onsite consultants
        • Project management
        • Innovation courses
        • Innovation programs
        • Subsidy applications
        • Seed capital
        • Innovation grants
        • MyStartUp
          • Boost your venture
          • Find your incubation program
          • MyStartUp Portfolio
        • MyInnovationFactory
          • Adjacent innovation for corporates
        • MyInnovationTalent
          • Boost your innovation capacity with on-site consultants
        • MyFutureProduct
          • Make your product smart & future-proof
  • Markets
        • Smart Space & Security

        • Microgravity
          Earth observation
          Navigation
          Exploration
          Security
        • Smart FMCG

        • Dispensers
          Cooling & heating
          Servers
          Smart packaging
          Vending equipment
        • Smart Life Sciences

        • MedTech
          BioTech
          HealthTech
          Ophthalmic
        • Smart Industry

        • Mobility & logistics
          Chemical & material
          Home, building & construction
          Manufacturing & equipment
          Energy
  • Capabilities
        • Strategic innovation

        • OpenLab
        • DesignLab
        • InnoLab
        • Digital innovation

        • DigitalLab
        • AILab
        • EmbeddedLab
        • Product innovation

        • MechLab
        • PhysicsLab
        • FabLab
        • High-tech innovation

        • OpticsLab
  • Technologies
        • Technologies

        • IoT & sensors
        • AI & data science
        • Robotics & autonomy
        • Cooling, heating & fluidics
        • Portfolio

  • About
        • About

        • News
        • Our story
  • Jobs
  • Contact

The future of energy-efficient AI systems

16 December 2022 Posted by Jente Somers Digital innovation

Did you know that training a large neural network produces up to 5 times more CO2 than an average car in its lifetime?! This showcases a huge problem: AI, in general, seems to consume a lot of power. Since we’re starting to collect more and more data annually, this problem will only continue to grow.

The future of energy-efficient AI systems

More data means more (and sometimes even bigger) models, which in turn increases energy consumption. We’re already aware of this rising problem, so we need to act NOW before it is too late. How do we do this?

1. We can start by optimizing the energy efficiency:

Connect the device to the cloud

In the cloud, hardware gets shared, meaning the power consumption gets centralized in one location. This gives us the opportunity to optimally use the hardware, optimize the power consumption and get large gains in return. Additionally, the necessary cooling for these large data centers can be optimized and the produced heat can even be recycled!

However, this poses scaling problems when the fleet of connected devices grows. To circumvent this, we can move the intelligence to the edge of the devices.

Reduce the energy consumption on the edge

For embedded or edge devices, the hardware doesn’t get shared. In this case, you need to maximize the ‘idle task’. Within the idle task, put the system in low power by using the low power level features of the hardware. Other possibilities are to reduce the complexity of the code or the number of computations.

2. Take into account the network quality:

Network-wise, not only the availability but also the quality (especially the latency) of the network should be considered with regard to power consumption. When the network connection is bad it takes the hardware longer to send the same amount of data, thus consuming more power. Research has even shown this relation is exponential!

Latency issue

So how can you tackle this latency problem? One possibility is to combine the data in batches before sending it to the cloud. An even better approach is to wait until the network connection is better, to reduce the required energy, to send these batches. You can also do parallel computing which is more efficient. But this ‘caching of data’ also brings problems along with it, i.e. you have to wait longer to get an answer back, so the Quality of Service (QoS) might be lower.

Both approaches discussed above come with advantages but also disadvantages. Each approach has its possibilities to help minimize energy usage, influencing the actual energy consumption.

3. If you can measure it, you can manage it!

So how do you decide which task to perform on either the edge or in the cloud? It might seem contradictory, but you can train an AI system with reinforcement learning to maximize the energy efficiency of each device (individually) throughout its lifetime. But in order to optimize something, you first need qualitative data and to get that data you need to measure whatever you want to optimize.

To make this concrete, let’s again look at optimizing the energy efficiency of a connected device. After deciding where to perform a task (edge or cloud), you can use the measurements of the power consumption to teach the model how good the decision was. This, however, also requires energy and time since you need to collect data and train the network. In the end, it’s a balancing exercise worth the effort, not only taking into account the technological but also the business side!

Balancing exercise of efforts

Key takeaways

  1. The energy efficiency can be optimized, either in the cloud or on the edge.
  2. The network quality, especially the latency, is also a key factor for energy consumption.
  3. With the use of AI, the optimal load balancing can be determined for each connected device (individually) to optimally use its battery.

Any questions or want to know more about this topic? Watch the complete presentation during our InnoDays webinar or get in touch!

Tags: Artificial intelligenceMachine & deep learning
Share
1

About Jente Somers

This author hasn't written their bio yet.
Jente Somers has contributed 2 entries to our website, so far.View entries by Jente Somers

You also might be interested in

Featured image - Perspective - The difference between Machine & Deep Learning

The difference between Machine & Deep Learning

Aug 12, 2020

And when to choose one or the other?

power-and-risks-of-AI-

The power and risks of AI

Aug 8, 2022

In this blogpost, we'll discuss the benefits and risks of AI that exceed human imagination and what this could mean for all of humanity.

Featured image - Webinar AI technology

Overcome the top 10 challenges of creating marketable AI products

May 10, 2021

In this webinar we discuss the difficulties in adopting AI technologies to create new radical AI product innovations.

Like this blog? Subscribe to the blogmail and don't miss any content!
Latest digital innovation blogposts
  • 20/03/2023
    Unlocking next-gen FMCG appliances with AI
  • 08/02/2023
    Robotics reinvented: a beginner’s guide to ROS
  • 12/01/2023
    AI, the rising star in earth observation
  • 16/12/2022
    The future of energy-efficient AI systems
  • 07/12/2022
    Maximizing customer engagement: AI and data in FMCG

Verhaert Masters in Innovation is a pioneering innovation group helping companies and entrepreneurs to innovate, creating new products, businesses and services.

Verhaert icon LinkedIn Verhaert icon Facebook Verhaert icon SlideShare Verhaert icon YouTube Verhaert icon Twitter

SERVICES
FUNDING
SOLUTIONS
MARKETS
CAPABILITIES
TECHNOLOGY
PERSPECTIVES
BLOGS
WEBINARS
ABOUT
NEWS
JOBS
CONTACT

© 2023 Verhaert New Products & Services NV • BE 0439.039.420 • Privacy policy • Terms of use

Prev Next