Proceedings

An Active Learning Approach to Home Heating in the Smart Grid

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 2892-2898.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

A key issue for the realization of the smart grid vision is the implementation of effective demand-side management. One possible approach involves exposing dynamic energy prices to end-users. In this paper, we consider a resulting problem on the user's side: how to adaptively heat a home given dynamic prices. The user faces the challenge of having to react to dynamic prices in real time, trading off his comfort with the costs of heating his home to a certain temperature. We propose an active learning approach to adjust the home temperature in a semi-automatic way. Our algorithm learns the user's preferences over time and automatically adjusts the temperature in real-time as prices change. In addition, the algorithm asks the user for feedback once a day. To find the best query time, the algorithm solves an optimal stopping problem. Via simulations, we show that our algorithm learns users' preferences quickly, and that using the expected utility loss as the query criterion outperforms standard approaches from the active learning literature.

  1. [Bartók and Szepesvári, 2012] Gábor Bartók and Csaba Szepesvári. Partial Monitoring with Side Information. In Proceedings of Algorithmic Learning Theory (ALT), 2012.
  2. [Beygelzimer et al., 2009] Alina Beygelzimer, Sanjoy Das- gupta, and John Langford. Importance Weighted Active Learning. In Proceedings of the International Conference on Machine Learning (ICML), 2009.
  3. [Bishop, 2006] Christopher M. Bishop. Pattern Recognition and Machine Learning (Information Science and Statis- tics). Springer-Verlag New York, Inc., Secaucus, NJ, USA, 2006.
  4. [Boutilier, 2002] C. Boutilier. A POMDP Formulation of Preference Alicitation Problems. In Proceedings of the National Conference on Artificial Intelligence (AAAI), 2002.
  5. [Cesa-Bianchi and Lugosi, 2006] Nicolò Cesa-Bianchi and Gábor Lugosi. Prediction, Learning, and Games. Cam- bridge University Press, 2006.
  6. [Cesa-Bianchi et al., 2005] Nicolò Cesa-Bianchi, Gábor Lu- gosi, and Gilles Stoltz. Minimizing Regret with Label Ef- ficient Prediction. IEEE Transactions of Information The- ory, 51(6):2152-2162, 2005.
  7. [Cesa-Bianchi et al., 2006] Nicolò Cesa-Bianchi, Claudio Gentile, and Luca Zaniboni. Worst-case Analysis of Se- lective Sampling for Linear Classification. Journal of Ma- chine Learning Research, 7:1205-1230, 2006.
  8. [Chajewska et al., 2000] U. Chajewska, D. Koller, and R. Parr. Making Rational Decisions Using Adaptive Util- ity Elicitation. In Proceedings of the National Conference on Artificial Intelligence (AAAI), 2000.
  9. [Cohn et al., 1996] David A. Cohn, Zoubin Ghahramani, and Michael I. Jordan. Active Learning with Statisti- cal Models. Journal of Artificial Intelligence Research, 4:129-145, 1996.
  10. [Cover and Thomas, 2006] Thomas M. Cover and Joy A. Thomas. Elements of Information Theory (2. ed.). Wiley, 2006.
  11. [Cramton and Ockenfels, 2011] Peter Cramton and Axel Ockenfels. Economics and Design of Capacity Markets for the Power Sector. Working Paper, University of Mary- land, May 2011.
  12. [Geman et al., 1992] Stuart Geman, Elie Bienenstock, and René Doursat. Neural Networks and the Bias/Variance Dilemma. Neural Computation, 4(1):1-58, January 1992.
  13. [Helmbold and Panizza, 1997] David P. Helmbold and San- dra Panizza. Some Label Efficient Learning Results. In Proceedings of the Conference on Learning Theory (COLT), 1997.
  14. [Jia and Tong, 2012] Liyan Jia and Lang Tong. Optimal Pric- ing for Residential Demand Response: A Stochastic Opti- mization Approach. In Proceedings of the Allerton Confer- ence on Communication, Control and Computing, 2012. [Jung, 2010] Alexander Jung. Teure Ersparnis. http://www.spiegel.de/spiegel/0,1518,711967,00.html. Accessed: October 2010. Link
  15. [Krause and Ong, 2011] Andreas Krause and Cheng Soon Ong. Contextual Gaussian Process Bandit Optimization. In Proceedings Neural Information Processing Systems (NIPS), 2011.
  16. [MacKay, 1992] David J. C. MacKay. Information-based Objective Functions for Active Data Selection. Neural Computation, 4(4):590-604, 1992.
  17. [McLaughlin et al., 2012] Zhe Yu Linda McLaughlin, Liyan Jia, Mary C. Murphy-Hoye, Annabelle Pratt, and Lang Tong. Modeling and Stochastic Control for Home Energy Management. In Proceedings of the Power and Energy Society (PES) General Meeting, 2012.
  18. [Peeters et al., 2009] Leen Peeters, Richard de Dear, Jan Hensen, and D'haeseleer William. Thermal Comfort in Residential Buildings: Comfort Values and Scales for Building Energy Simulation. Applied Energy, 86(5):772- 780, 2009.
  19. [Peskir and Shiryaev, 2006] Goran Peskir and Albert Shiryaev. Optimal Stopping and Free-Boundary Prob- lems. Lectures in Mathematics, ETH Zürich. Birkhäuser Verlag, 2006.
  20. [Ramchurn et al., 2012] Sarvapali Ramchurn, Perukrishnen Vytelingum, Alex Rogers, and Nicholas R. Jennings. Putting the "Smarts" into the Smart Grid: A Grand Chal- lenge for Artificial Intelligence. Communications of the ACM, 55(4):86-97, 2012.
  21. [Rogers et al., 2011] Alex Rogers, Sasan Maleki, Siddhartha Ghosh, and Jennings Nicholas R. Adaptive Home Heating Control Through Gaussian Process Prediction and Mathe- matical Programming. In Proceedings of the Second Inter- national Workshop on Agent Technology for Energy Sys- tems (ATES), 2011.
  22. [Settles, 2009] B. Settles. Active Learning Literature Survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, 2009.
  23. U. S. Department Of Energy. Grid 2030: A National Vision For Electricity - Second 100 Years. 2003.
  24. [VDE, 2012] VDE. Demand Side Integration -Lastver- schiebungspotenziale in Deutschland. Technical Report, VDE Verband the Elektrotechnik, June 2012.
  25. [Vytelingum et al., 2010] Perukrishnen Vytelingum, Thomas D. Voice, Sarvapali D. Ramchurn, Alex Rogers, and Nicholas R. Jennings. Agent-based Micro-storage Management for the Smart Grid. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2010.
  26. [Weron, 2006] Rafal Weron. Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach. HSC Books. Hugo Steinhaus Center, Wroclaw University of Technology, 2006.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards