Thursday, March 9, 2023

Neural NILM Learning Paradigms: From Centralised to Decentralised Learning

Centralised vs collaborative learning
Non-intrusive Load Monitoring (NILM) has become a paramount in both industrial and residential sectors to achieve efficient energy consumption. Deep neural networks have been gaining the highest interest from the research community, commonly referred to as neural NILM. In most cases, neural NILM models follow a centralised based learning scheme, where the energy data is assumed to be available in a central node for training. This practice can, however, raise privacy and security concerns from the consumer’s side since energy data can reveal in-home activities and occupancy records if intercepted. In response, Federated Learning (FL) has been suggested as a viable solution to address these issues. In the paper "Neural NILM Learning Paradigms: From Centralised to Decentralised Learning", an overview of neural NILM models following both a centralised and a federated learning paradigm was presented while also identifying the main challenges with regard to both learning paradigms and potential future research directions for more robust, secure and privacy-preserving models in the neural NILM industry. Overall, as any other new technology, FL has its merits and limitations. Typically, FL provides promising perspectives to solve the privacy issues of energy disaggregation. However, it also opens doors for new challenges, especially those related to the (i) low disaggregation performance of FL-based NILM algorithms, (ii) susceptibility to noise, (iii) lack of labeled sub-metered data at the customer’s level, and (iv) need to adopt robust security mechanisms.

Further information can be found in the paper:

Hafsa Bousbiat, Christoph Klemenjak, Yassine Himeur, Wilfried Elmenreich, Abbes Amira, Wathiq Mansoor, and Shadi Atalla. Neural NILM learning paradigms: From centralised to decentralised learning. In Proceedings of the 2022 5th International Conference on Signal Processing and Information Security (ICSPIS), pages 138–142, December 2022. (doi:10.1109/icspis57063.2022.10002485)

The paper also won the best paper award at the 5th International Conference on Signal Processing and Information Security (ICSPIS) in December 2012.


Thursday, March 2, 2023

The Role of Renewable Energies in the Arctic

Last week, Prof. David Finger from Sustainability Institute and Forum at Reykjavik University visited the University of Klagenfurt as a guest researcher. His inspiring talk at Energy Cluster Meeting XXXI, titled "Climate-Neutral Europe: the Role of Renewable Energies in the Arctic to decarbonize Europe and enhance energy independence", was truly captivating and gave us all a glimpse into the possibilities of an Austrian-Icelandic Energy Cooperation. 

Students and researchers alike were amazed by the future of renewable energy in Europe that Prof. Finger's talk highlighted and left the room with interesting insights into the role of renewable energy in the Arctic. It was a great opportunity to learn more about the progress of climate neutrality and energy independence in Europe and we look forward to further collaborations with Prof. Finger in the future.

Wednesday, March 1, 2023

Energy Informatics 2023 in Vienna -- Call for Papers

The EU aims to be climate-neutral by 2050 – an economy with net-zero greenhouse gas emissions. This objective is at the heart of the European Green Deal and in line with the EU’s commitment to global climate action under the Paris Agreement. The transition to a climate-neutral society is both an urgent challenge and an opportunity to build a better future for all. Energy informatics support in solving many challenges of the energy transition, by providing solutions for intelligent management and operation of energy systems and their assets.

The objective of the DACH+ conference series on Energy Informatics is to promote research, development, and implementation of information and communication technologies in the energy domain and to foster the exchange between academia, industry, and service providers in the German-Austrian-Swiss region and its neighbouring countries (DACH+).

We seek high-quality original contributions addressing the design, adoption, operation and management of smart energy systems, the integration of intermittent renewable generation and energy efficiency gains through ICT, market approaches and mechanisms for ICT-enabled energy systems, and research on associated (decentralised) data-driven decisions. We welcome theoretical contributions as well as publications addressing system design, implementation, and experimentation. The list of topics of interest to the conference includes, but is not limited to:

  • ICT for future energy systems, sector coupling and the integration of intermittent renewable generation
  • Information and decision support systems for future energy markets and mechanisms
  • Energy system modelling and (open) energy system data
  • Protocols and architectures for IT systems in the energy sector
  • Data analytics and machine learning for smart energy systems and decentralised decision-making, as well as platforms for data analysis
  • Open data and software for energy research
  • Management of distributed generation and demand side management
  • ICT for (multi-) energy networks and micro-grids
  • Energy-efficient mobility, charging management for electric vehicles, energy-aware traffic control, and smart grid integration of mobile storage
  • Smart buildings, digital metering, occupant comfort, and user interaction
  • Adoption of ICT in the energy sector
  • Cross-cutting issues including cyber security and privacy protection, interoperability, verification of networked smart grid systems

Posters, Demos and Workshops

Submissions for posters, demos, and workshop suggestions are welcome, too. The topics of interest are the same as indicated above. Posters and demos require the submission of an extended abstract, which will be peer-reviewed. If accepted, the abstract will appear in the conference proceedings. Further details can be found on the conference website.

Submission and Publication

Submitted papers will be reviewed in a double-blind process. Accepted and presented papers will be published in the Springer Open Journal Energy Informatics (https://energyinformatics.springeropen.com). The conference language is English, and papers must be written in English. We solicit full research papers (max. 18 pages of content plus 2 additional pages for references) as well as short papers (max. 10 pages of content plus 2 additional pages for references). Templates and instructions will be made available at http://www.energy-informatics.eu/. Further information on the submission of posters and demos is also available on the website. The Open Access fee for the journal article is included in the registration fee.

Important dates

Apr 09, 2023:                     Submission of papers

May 16, 2023:                     Decision acceptance (assignment of shepherds) / rejection

May – Aug                          Incremental revision process between author and shepherd

Jul 02, 2023:                        Camera-ready deadline for poster abstracts for accepted contributions

Oct 04 2023:                      14th Doctoral Workshop Energy Informatics

Oct 05-06, 2023:                12th DACH+ Conference on Energy Informatics

Thursday, February 23, 2023

Energy to train AI tools, wasted?

Energy used to make and provide online services is an important consideration for many reasons. Production and delivery of online services require energy, and that energy has a direct impact on the environment. The energy used to create and provide online services often comes from burning fossil fuels, such as coal, natural gas, and oil. This burning releases carbon dioxide (CO2) and other pollutants into the atmosphere, contributing to global warming. Burning fossil fuels also releases other harmful pollutants, such as particulate matter, sulfur dioxide, and nitrogen oxides, contributing to air pollution and can cause serious health problems. Increased energy consumption also has a direct effect on our environment. As energy consumption increases, so does the demand for resources such as coal, natural gas, and oil. This can lead to the destruction of ecosystems and habitats, as well as the displacement of communities. Additionally, burning these resources to produce energy contributes to climate change, causing a shift in weather patterns, rising sea levels, and an increase in extreme weather events. The energy used to provide online services also has an impact on the cost of providing these services. The more energy used to power the servers and networks, the more expensive the services become. Additionally, higher energy costs can lead to higher consumer prices, as companies must pass on the extra costs to their customers. Finally, suppose energy used to provide online services is generated from non-renewable sources, such as coal and oil. In that case, it means that the energy used to power these online services will eventually run out, which could negatively impact the availability of these services in the future. Overall, it is essential to consider the energy used to make and provide online services. Burning fossil fuels to power these services contributes to air pollution and global warming while also increasing costs. Additionally, the use of non-renewable resources to generate energy could lead to a decrease in the availability of these services in the future. 

A prominent example of online services is AI chatbots that can provide the user with answers to almost any topic. Other than a search engine that only finds matches of the search text in the indexed documents, AI chatbots can compose new information by drawing connections between the vast amount of information they have been trained with. AI programs like ChatGPT are a highly relevant development because they significantly improve the user experience and enable people from all domains to access sophisticated AI technology. Open AI programs make AI more accessible, allowing developers to share and collaborate on AI models. It also helps reduce development costs and makes integrating AI into existing applications easier. By allowing developers to access and build upon existing models, they can create new and innovative applications that can benefit everyone. Developing AI models helps automate tedious tasks and reduce the time spent on manual labor. By using AI models, businesses can automate mundane tasks and improve their workflow. AI models can also help to improve customer support and increase customer satisfaction. AI models are also important for predicting future trends and predicting customer behavior.

But, despite the fact that users of AI often get free access or a generous free trial, developing and training an AI model does not come for free when we consider the energy budget. The Carbon footprint of training ChatGPT has been estimated to be 1287 MWh [1], in addition to running the services. Are 1287 MWh a number to be concerned with? Probably yes. Is it a number so high that we immediately need to banish AI training for the sake of the environment? I don't think so.

When relating 1287 MWh to a single person, it is a lot. It would mean driving an average European car on fossil fuels for 4,5 Mio km. That is enough to travel the whole road network of the United States or equivalent to the carbon footprint of a flight passenger going form London to New York 320 times.

Nevertheless, ChatGPT has more than one user. In fact, it is one of the fastest-growing online platforms in the world, with around 100 Million users at the time of writing. Dividing the development costs by the users, it amounts to 0.01287 kWh or roughly 1% of the energy required to print a book. 

In other words, if users can utilize the AI system to automate mundane tasks and improve their workflow, the energy spent on creating the AI is probably well-invested. Many usages are recreational, and sometimes the AI provides more fiction than facts, but so is the case with books.

However, we need to keep our eyes open on two issues:

  • The operational cost of running the system: "Cost" would mean here energy cost as well as financial cost. If the system does not work here efficiently, we could end up in a much higher energy waste than 1287 MWh
  • Further developments in training new AIs: competitors might train their own AIs, no matter the (energy) cost. And models are expected to grow in complexity and capabilities, probably also significantly raising the energy required for training a single model.
So let's keep an eye on further developments.

[1] Patterson, D., Gonzalez, J., Hölzle, U., Le, Q., Liang, C., Munguia, L.-M., … Dean, J. (4 2022). The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink. Computer, 55, 18–28. Retrieved from http://arxiv.org/abs/2204.05149

Thursday, January 20, 2022

Energy Informatics 2022 -- Call for Papers

Countries worldwide have strengthened their commitment to decarbonize the energy system at COP26 in Glasgow. This intent necessitates a massive increase in renewable power generation and the electrification of energy demand through sector coupling (e.g., heat and mobility). Over the last year, for example, the DACH countries have created roadmaps to establish hydrogen as an additional sustainable energy carrier. Energy informatics contributes to solving many of the challenges of this energy transition, by connecting various decentralized resources and by operating them intelligently.

The objective of the DACH+ conference series on Energy Informatics is to promote research, development, and implementation of information and communication technologies in the energy domain and to foster the exchange between academia, industry, and service providers in the German-Austrian-Swiss region and its neighbouring countries (DACH+).

We seek high-quality original contributions addressing the design, adoption, operation and management of smart energy systems, the integration of intermittent renewable generation and energy efficiency gains through ICT, market approaches and mechanisms for ICT-enabled energy systems, and research on associated (decentralised) data-driven decisions. We welcome theoretical contributions as well as publications addressing system design, implementation, and experimentation. The list of topics of interest to the conference includes, but is not limited to:

  • ICT for future energy systems, sector coupling and the integration of intermittent renewable generation
  • Information and decision support systems for future energy markets and mechanisms
  • Energy system modelling and (open) energy system data
  • Protocols and architectures for IT systems in the energy sector
  • Data analytics and machine learning for smart energy systems and decentralised decision making, as well as platforms for data analysis
  • Open data and software for energy research
  • Management of distributed generation and demand side management
  • ICT for (multi-) energy networks and micro-grids
  • Energy-efficient mobility, charging management for electric vehicles, energy-aware traffic control, and smart grid integration of mobile storage
  • Smart buildings, digital metering, occupant comfort, and user interaction
  • Adoption of ICT in the energy sector
  • Cross-cutting issues including cyber security and privacy protection, interoperability, verification of networked smart grid systems

Important Date

  • Paper, poster & demo submission: Apr 8, 2022
  • Notification: Jun 6, 2022
  • Camera-ready paper due: Jun 24, 2022
  • Doctoral Workshop: Sep 13-14, 2022
  • Conference: Sep 15-16, 2022

Posters, Demos and Workshop

 
Submissions for posters, demos, and workshop suggestions are welcome, too. Details can be found on the conference website.

Submission and Publication

 
Submitted papers will be reviewed in a double-blind process. Accepted and presented papers will be published in the Springer Open Journal Energy Informatics https://energyinformatics.springeropen.com. The conference language is English, and papers must be written in English. We solicit full research papers (max. 18 pages of content plus 2 additional pages for references) as well as short papers (max. 10 pages of content plus 2 additional pages for references). Templates and instructions will be made available at https://www.energy-informatics.eu/. Further information on the submission of posters and demos is also available on the website. The Open Access fee for the journal article is included in the registration fee.

Tuesday, January 5, 2021

Investigating the impact of data quality on the energy yield forecast using data mining techniques

In this paper, we analysed the impact of using optimum combination of input variables and low dimensional subspace on Photovoltaic (PV) production forecasting accuracy. We worked in collaboration with Prof. Mussetta from Politecnico di Milano.

The main contribution presented in the paper is divided in two parts:
  1. Optimum combination of input meteorological features using feature extraction technique
  2. Low dimensional subspace using dimensional reduction technique
We assess and compare two cases when forecasting models are fed with all the features with the case when low subspace of dataset is used as an input to the models.
The simulation results reveal that depending on the location under study and the regression methods, using less variables as input to the forecasting models are enough to generate nearly similar results without affecting the performance. However, it is necessary to conduct the tests under different climatic conditions so as to ensure the reliability of the results. 
The figures below show the results obtained applying Pearsons correlation and principal component analysis. Figure 1 represents strength of association between two variables. Figure 2 is the biplot representation of the input features contributing variance on principal components PC1 and PC2.

Fig.1 : Pearson correlation map


Fig.2 : Biplot representation 


ISGT Europe 2020 was held virtually and we recorded the presentation for the same. The presentation is available at this link.

 

To support reproducibility and validating the results we have released the dataset utilized in the work along with the codes. 

Github repository with used dataset and evaluation code

For more information please see the paper:

Ekanki Sharma, Marco Mussetta, and Wilfried Elmenreich. Investigating the impact of data quality on the energy yield forecast using data mining techniques. In Proceedings of the IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe). IEEE, October 2020.

Monday, November 16, 2020

Investigating the Benefit of Time-Series Imaging for Load Disaggregation

In this paper, we investigate the benefits of time-series imaging in load disaggregation, as we augment the wide-spread sequence-to-sequence approach by a key element: an imaging block.  

A Recurrence Plot
The approach presented in this paper converts an input sequence to an image, which in turn serves as input to a modified version of a common Denoising Autoencoder architecture used in load disaggregation. Based on these input images, the Autoencoder estimates the power consumption of a particular appliance. 

The main contribution presented in this paper is a comparison study of three common imaging techniques: 

  • Gramian Angular Fields, 
  • Markov Transition Fields, 
  • Recurrence Plots.
Further, we assess the performance of our augmented networks by a comparison with two benchmarking implementations, one based on Markov Models and the other one being a common Denoising Autoencoder. ´

The outcome of our study reveals that in 19 of 24 cases, the considered augmentation techniques provide improved performance over the baseline implementation. Further, the findings presented in this paper indicate that the Gramian Angular Field could be better suited, though the Recurrence Plot was observed to be a viable alternative in some cases. 

Our paper is to appear at the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys ’20):

Hafsa Bousbiat, Christoph Klemenjak, and Wilfried Elmenreich. 2020. Exploring Time Series Imaging for Load Disaggregation. In The 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys ’20), November 18–20, 2020, Virtual Event, Japan.

 We are looking forward to discussing our paper at BuildSys!