Mobility-Aware Vehicle-to-Grid Control Algorithm in Microgrids

Haneul Ko, Sangheon Pack, Victor C.M. Leung

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

In a vehicle-to-grid (V2G) system, electric vehicles (EVs) can be efficiently used as power consumers and suppliers to achieve microgrid (MG) autonomy. Since EVs can act as energy transporters among different regions (i.e., MGs), it is an important issue to decide where and when EVs are charged or discharged to achieve the optimal performance in a V2G system. In this paper, we propose a mobility-aware V2G control algorithm (MACA) that considers the mobility of EVs, states of charge of EVs, and the estimated/actual demands of MGs and then determines charging and discharging schedules for EVs. To optimize the performance of MACA, the Markov decision process problem is formulated and the optimal policy on charging and discharging is obtained by a value iteration algorithm. Since the mobility of EVs and the estimated/actual demand profiles of MGs may not be easily obtained, a reinforcement learning approach is also introduced. Evaluation results demonstrate that MACA with the optimal and learning-based policies can effectively achieve MG autonomy and provide higher satisfaction on the charging.

Original languageEnglish
JournalIEEE Transactions on Intelligent Transportation Systems
DOIs
Publication statusAccepted/In press - 2018 Apr 10

Fingerprint

Electric vehicles
Reinforcement learning

Keywords

  • Batteries
  • electric vehicle (EV)
  • Markov decision process (MDP)
  • Markov processes
  • Mathematical model
  • microgrid
  • Microgrids
  • reinforcement learning (RL)
  • State of charge
  • Vehicle-to-grid
  • Vehicle-to-grid (V2G)

ASJC Scopus subject areas

  • Automotive Engineering
  • Mechanical Engineering
  • Computer Science Applications

Cite this

Mobility-Aware Vehicle-to-Grid Control Algorithm in Microgrids. / Ko, Haneul; Pack, Sangheon; Leung, Victor C.M.

In: IEEE Transactions on Intelligent Transportation Systems, 10.04.2018.

Research output: Contribution to journalArticle

@article{8840f0f148824c65862c53cb9663abe9,
title = "Mobility-Aware Vehicle-to-Grid Control Algorithm in Microgrids",
abstract = "In a vehicle-to-grid (V2G) system, electric vehicles (EVs) can be efficiently used as power consumers and suppliers to achieve microgrid (MG) autonomy. Since EVs can act as energy transporters among different regions (i.e., MGs), it is an important issue to decide where and when EVs are charged or discharged to achieve the optimal performance in a V2G system. In this paper, we propose a mobility-aware V2G control algorithm (MACA) that considers the mobility of EVs, states of charge of EVs, and the estimated/actual demands of MGs and then determines charging and discharging schedules for EVs. To optimize the performance of MACA, the Markov decision process problem is formulated and the optimal policy on charging and discharging is obtained by a value iteration algorithm. Since the mobility of EVs and the estimated/actual demand profiles of MGs may not be easily obtained, a reinforcement learning approach is also introduced. Evaluation results demonstrate that MACA with the optimal and learning-based policies can effectively achieve MG autonomy and provide higher satisfaction on the charging.",
keywords = "Batteries, electric vehicle (EV), Markov decision process (MDP), Markov processes, Mathematical model, microgrid, Microgrids, reinforcement learning (RL), State of charge, Vehicle-to-grid, Vehicle-to-grid (V2G)",
author = "Haneul Ko and Sangheon Pack and Leung, {Victor C.M.}",
year = "2018",
month = "4",
day = "10",
doi = "10.1109/TITS.2018.2816935",
language = "English",
journal = "IEEE Transactions on Intelligent Transportation Systems",
issn = "1524-9050",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Mobility-Aware Vehicle-to-Grid Control Algorithm in Microgrids

AU - Ko, Haneul

AU - Pack, Sangheon

AU - Leung, Victor C.M.

PY - 2018/4/10

Y1 - 2018/4/10

N2 - In a vehicle-to-grid (V2G) system, electric vehicles (EVs) can be efficiently used as power consumers and suppliers to achieve microgrid (MG) autonomy. Since EVs can act as energy transporters among different regions (i.e., MGs), it is an important issue to decide where and when EVs are charged or discharged to achieve the optimal performance in a V2G system. In this paper, we propose a mobility-aware V2G control algorithm (MACA) that considers the mobility of EVs, states of charge of EVs, and the estimated/actual demands of MGs and then determines charging and discharging schedules for EVs. To optimize the performance of MACA, the Markov decision process problem is formulated and the optimal policy on charging and discharging is obtained by a value iteration algorithm. Since the mobility of EVs and the estimated/actual demand profiles of MGs may not be easily obtained, a reinforcement learning approach is also introduced. Evaluation results demonstrate that MACA with the optimal and learning-based policies can effectively achieve MG autonomy and provide higher satisfaction on the charging.

AB - In a vehicle-to-grid (V2G) system, electric vehicles (EVs) can be efficiently used as power consumers and suppliers to achieve microgrid (MG) autonomy. Since EVs can act as energy transporters among different regions (i.e., MGs), it is an important issue to decide where and when EVs are charged or discharged to achieve the optimal performance in a V2G system. In this paper, we propose a mobility-aware V2G control algorithm (MACA) that considers the mobility of EVs, states of charge of EVs, and the estimated/actual demands of MGs and then determines charging and discharging schedules for EVs. To optimize the performance of MACA, the Markov decision process problem is formulated and the optimal policy on charging and discharging is obtained by a value iteration algorithm. Since the mobility of EVs and the estimated/actual demand profiles of MGs may not be easily obtained, a reinforcement learning approach is also introduced. Evaluation results demonstrate that MACA with the optimal and learning-based policies can effectively achieve MG autonomy and provide higher satisfaction on the charging.

KW - Batteries

KW - electric vehicle (EV)

KW - Markov decision process (MDP)

KW - Markov processes

KW - Mathematical model

KW - microgrid

KW - Microgrids

KW - reinforcement learning (RL)

KW - State of charge

KW - Vehicle-to-grid

KW - Vehicle-to-grid (V2G)

UR - http://www.scopus.com/inward/record.url?scp=85045301891&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045301891&partnerID=8YFLogxK

U2 - 10.1109/TITS.2018.2816935

DO - 10.1109/TITS.2018.2816935

M3 - Article

AN - SCOPUS:85045301891

JO - IEEE Transactions on Intelligent Transportation Systems

JF - IEEE Transactions on Intelligent Transportation Systems

SN - 1524-9050

ER -