Projects - User contributions [en]

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T14:18:56Z

A1684007: /* Performance of Battery Management System */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

Extended Kalman filter (EKF) is used as our battery management system (BMS) to obtain accurate SoC estimation. An accurate SoC estimation is needed because we want to prevent the battery from over-charging or under-charging which can cause permanent damage to the battery and reduces its lifetime. EKF is an intelligent and optimal algorithm, it can deal with the non-linearity of the battery model which cause by the dynamic response during battery charging or discharging. EKF is also has the ability to handle variable that cannot measure directly. In the case of BMS, the unmeasurable value is SOC.

The figure shown below represents the whole process of the EKF. The EKF takes battery terminal current I(k) as input, battery terminal voltage V(k) as output and battery SOC as the state which is our variable of interest. First, the EKF use the previous state and current to predict the current state. Then, it estimates the output voltage by using I(k) and current state from prediction. After that, it linearises the battery model by doing derivative and calculates the Kalman gain. At last, it compares the estimated output voltage V ̂(k) with the measured output voltage V(k) by using the Kalman gain to determine the weighting between the two output voltage and update the state. These steps are doing iteratively.

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===

Figure below shows the SOC of the battery with error bound with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Error bound.jpg|600px|frameless|center]]

Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

File:Error bound.jpg

2019-10-29T14:17:43Z

A1684007:

SOC with Error Bound

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T14:16:25Z

A1684007: /* Battery Management System Design */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

Extended Kalman filter (EKF) is used as our battery management system (BMS) to obtain accurate SoC estimation. An accurate SoC estimation is needed because we want to prevent the battery from over-charging or under-charging which can cause permanent damage to the battery and reduces its lifetime. EKF is an intelligent and optimal algorithm, it can deal with the non-linearity of the battery model which cause by the dynamic response during battery charging or discharging. EKF is also has the ability to handle variable that cannot measure directly. In the case of BMS, the unmeasurable value is SOC.

The figure shown below represents the whole process of the EKF. The EKF takes battery terminal current I(k) as input, battery terminal voltage V(k) as output and battery SOC as the state which is our variable of interest. First, the EKF use the previous state and current to predict the current state. Then, it estimates the output voltage by using I(k) and current state from prediction. After that, it linearises the battery model by doing derivative and calculates the Kalman gain. At last, it compares the estimated output voltage V ̂(k) with the measured output voltage V(k) by using the Kalman gain to determine the weighting between the two output voltage and update the state. These steps are doing iteratively.

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T14:14:44Z

A1684007: /* Battery Management System Design */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

Extended Kalman filter (EKF) is used as our battery management system (BMS) to obtain accurate SoC estimation. An accurate SoC estimation is needed because we want to prevent battery from over-charging or under-charging which can cause permanent damage to the battery and reduces its lifetime. EKF is an intelligent and optimal algorithm, it can deal with the non-linearity of the battery model which cause by the dynamic response during battery charging or discharging. EKF is also has ability to handle variable that cannot measure directly. In the case of BMS, the unmeasurable value is SOC.

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T12:04:38Z

A1684007: /* Result & Discussion */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T12:04:24Z

A1684007: /* Simulator of the FCHV */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T12:03:50Z

A1684007: /* PEM Fuel Cell System */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T12:03:30Z

A1684007: /* PEM Fuel Cell System */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:FcHdfff.png|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

File:FcHdfff.png

2019-10-29T12:03:18Z

A1684007:

Fuel Cell Stack

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T12:02:31Z

A1684007: /* Power Plant */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:Abb-fc-system.jpg|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [2], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T12:02:08Z

A1684007: /* Reference */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:Abb-fc-system.jpg|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' S. V. Puranik, A. Keyhani and F. Khorrami, "State-Space Modeling of Proton Exchange Membrane Fuel Cell," in IEEE Transactions on Energy Conversion, vol. 25, no. 3, pp. 804-813, Sept. 2010.
:'''[2]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[3]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[4]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[5]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:48:00Z

A1684007: /* PEM Fuel Cell System */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. Figure for the PEM fuel cell is shown below [1].

[[File:Abb-fc-system.jpg|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:45:50Z

A1684007: /* Fuel Cell */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''PEM Fuel Cell System''' ===
Polymer electrolyte membrane (PEM) fuel cells are the current focus of research for fuel cell vehicle applications. PEM fuel cells are made from several layers of different materials. The main parts of a PEM fuel cell are described below.

[[File:Abb-fc-system.jpg|600px|frameless|center]]

PEM fuel cell stack is a device that generates electricity by a chemical reaction. Every fuel cell has two electrodes called, respectively, the anode and cathode. The reactions that produce electricity take place at the electrodes. Every fuel cell also contain electrolytes which carries electrically charged particles from one electrode to the other, and a catalyst, which speeds the reactions at the electrodes. This process will produce hydrogen and oxygen gas as the hydrogen particle gains electron to form hydrogen gas while water particle losses electron to form oxygen gas and hydrogen particles.

[[File:Equation2.png|frameless|center]]

Oxygen enters the fuel cell at the cathode, then combines with electrons returning from the electrical circuit and hydrogen ions travelled through the electrolyte from the anode. In other cell types the oxygen picks up electrons and then travels through the electrolyte to the anode, where it combines with hydrogen ions.

The electrolyte plays a key role. It must permit only the appropriate ions to pass between the anode and cathode. If free electrons or other substances could travel through the electrolyte, they would disrupt the chemical reaction.

Whether they combine at anode or cathode, together hydrogen and oxygen form water, which drains from the cell. As long as a fuel cell is supplied with hydrogen and oxygen, it will generate electricity.

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

File:Equation2.png

2019-10-29T11:43:29Z

A1684007:

FCS equation

File:Abb-fc-system.jpg

2019-10-29T11:35:57Z

A1684007:

Fuel Cell System

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:32:23Z

A1684007: /* Background */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell''' ===

=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:26:31Z

A1684007: /* Performance of Battery Management System */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===
Figure below shows the SoC of the battery with Kalman Filter method compared with battery model from MATLAB/Simulink

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:24:21Z

A1684007: /* Performance of Energy Management Strategy */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

The results above use the same driving cycle, we can see that the total fuel consumption for the MDP strategy is slightly lower compared to the rule-based strategy after the end of the driving cycle. Also, both of the methods have similar results for the SoC of the battery and maintaining the SoC at 50%.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:20:11Z

A1684007: /* Performance of Energy Management Strategy */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

'''The figure below shows the Comparison of Fuel Consumption with MDP and Ruled-Based'''
[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

'''The figure below shows the Total Fuel Consumption with MDP and Ruled-Based'''
[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

'''The figure below shows the Comparison of SoC of Battery with MDP and Ruled-Based'''
[[File:SOC vs Time.jpg|600px|frameless|center]]

Using the same driving cycle, the total fuel consumption for MDP strategy is slightly lower than rule-based strategy after the end of the driving cycle.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:16:11Z

A1684007: /* High Level Design */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable.

Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

Using the same driving cycle, the total fuel consumption for MDP strategy is slightly lower than rule-based strategy after the end of the driving cycle.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:15:48Z

A1684007: /* Energy Management Strategy Design */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable. Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure below. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

[[File:MDP Bellman.png|500px|center|frameless]]

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

Using the same driving cycle, the total fuel consumption for MDP strategy is slightly lower than rule-based strategy after the end of the driving cycle.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T11:14:45Z

A1684007: /* High Level Design */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===

After designing the power plant of the FCHV, the design of the overall system was further expanded to observe the behaviour of the power plant based on the driving cycle of the vehicle as the input. The main purpose of developing the Energy Management System (EMS) is to regulate the energy flow between the fuel cell and battery while minimising the fuel consumption of the vehicle and sustain the battery SoC. Next, the Battery Management System (BMS) focuses on the estimate the SoC of the battery because in practical, the SoC of the battery is not observable. Further detail of motor controller, EMS and BMS will be discussed below.

[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

Using the same driving cycle, the total fuel consumption for MDP strategy is slightly lower than rule-based strategy after the end of the driving cycle.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:35:58Z

A1684007: /* Power Plant */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===
[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

The MDP strategy consumes more hydrogen fuel at the start to reach the SoC reference faster compared to rule-based strategy. Then it will maintain the SoC at the reference which is 50%. Using the same driving cycle, the total fuel consumption for MDP strategy is lower than rule-based strategy.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:35:39Z

A1684007: /* Fuel Cell Hybrid Vehicle */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in figure below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on figure below, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the Figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===
[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

The MDP strategy consumes more hydrogen fuel at the start to reach the SoC reference faster compared to rule-based strategy. Then it will maintain the SoC at the reference which is 50%. Using the same driving cycle, the total fuel consumption for MDP strategy is lower than rule-based strategy.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:35:03Z

A1684007: /* Power Plant */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in Figure 1 below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on Figure 1, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the Figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

After listing the specification of the FCHV, the energy flow of the energy is required to understand beforehand before doing the energy management system of the vehicle. In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===
[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

The MDP strategy consumes more hydrogen fuel at the start to reach the SoC reference faster compared to rule-based strategy. Then it will maintain the SoC at the reference which is 50%. Using the same driving cycle, the total fuel consumption for MDP strategy is lower than rule-based strategy.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:33:17Z

A1684007: /* Power Plant */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in Figure 1 below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on Figure 1, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the Figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

In order to understand the energy flow of the FCHV, the system block diagram of the energy flow of the FCHV is shown below to illustrate how the energy flows inside the FCHV.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total power demand formulation from the motor driver can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===
[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

The MDP strategy consumes more hydrogen fuel at the start to reach the SoC reference faster compared to rule-based strategy. Then it will maintain the SoC at the reference which is 50%. Using the same driving cycle, the total fuel consumption for MDP strategy is lower than rule-based strategy.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:30:29Z

A1684007: /* Performance of Energy Management Strategy */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in Figure 1 below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on Figure 1, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the Figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

The system block diagram of the energy flow of the FCHV to demonstrate how the energy flow between the power plant in the vehicle.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total required power formulation can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===
[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|600px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|600px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|600px|frameless|center]]

The MDP strategy consumes more hydrogen fuel at the start to reach the SoC reference faster compared to rule-based strategy. Then it will maintain the SoC at the reference which is 50%. Using the same driving cycle, the total fuel consumption for MDP strategy is lower than rule-based strategy.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:27:27Z

A1684007: /* Battery Management System Design */

=='''Project team'''==
=== '''Project members''' ===
*Loqman Al Hakim Aripin
*Jan Zhen Pang
*Tsz Yee Ha

=== '''Supervisors''' ===
*Prof. Cheng Chew Lim
*Prof. Peng Shi

=== '''Technical advisor''' ===
*Mr. Di Shen

== '''Introduction''' ==
=== '''Why Fuel Cell Hybrid Vehicle?''' ===
Fuel Cell Hybrid Vehicle (FCHV) uses hydrogen gas to fuel the vehicle. Compared to a conventional vehicle, this vehicle produces zero-emission since it only emits water vapour. This is one of the solutions for an eco-friendly vehicle. In addition, fuel cell hybrid vehicle does not need to charge the battery since it capable to maintain the battery SoC at a certain level. This has the advantages over the pure electric vehicle which need to take a long period of time to fully charge the battery.

In order to maintain the State of Charge (SoC) of the battery, the energy flow inside the FCHV needs to be regulated. This motivates the project to develop a Power Control Unit (PCU) to regulate the energy flow between fuel cell stack (FCS) and the battery.

However, the SoC of a battery is practically not observable. This requires the team to develop a Battery Management Strategy to estimate the SoC of the battery.

=== '''Aims''' ===
The aims of this project are:
*Develop a PCU for the Energy Management Strategy where it capable to:
**To control and regulate the power flow from two power sources (FCS and battery) of the FCHV
**Minimise the total hydrogen fuel consumption
**Maintain the SoC of the battery
**To consider and observe the power density and the energy density to achieve optimal energy storage for the FCHV
*Develop a Battery Management System to estimate the SoC of the battery
*Develop a fully functional simulator to analyse the performance of the PCU

== '''Background''' ==
=== '''Fuel Cell Hybrid Vehicle''' ===

In recent years, the development of hybrid vehicles increases dramatically where hybrid electric vehicles (HEVs) are widely used throughout the world. The term hybrid vehicle generally means that the vehicle uses one or more different form of power sources to power up the vehicle. In this project, we will focus on Fuel Cell Hybrid Vehicle (FCHV), where it uses hydrogen gas as fuel to power the vehicle. In addition, the battery pack is also added to act as energy storage and provide sufficient energy to the vehicle when necessary.

Moreover, FCHV consists of several modes during operation such as fuel cell mode, hybrid mode, battery mode and regenerative braking mode which is shown in Figure 1 below. Firstly, fuel cell mode power up the vehicle while charging the battery by just using the fuel cell stack. During the battery mode, the only power source of the vehicle is battery. The hybrid mode made up of two different power sources (FCS and battery) supplying power to drive the vehicle. Lastly regenerative braking mode supplies power back to the battery pack by converting the kinetic energy of the vehicle into electric energy.

Based on Figure 1, the FCHV mainly uses the combination of the FCS, battery pack, motor driver and DC-DC converter. A PCU is needed in order to regulate and control multiple power sources of the FCHV.

[[File:4 Modes of Vehicle.png|500px|center|frameless|Figure 1: 4 Modes of FCHV.]]

== '''Methodology''' ==
=== '''Power Plant''' ===
FCHV system mainly uses the combination of PEM fuel cell stack, DC-DC converter, PCU, 24V Nickel Metal Battery Pack, Electric Motor and Motor Driver. DC-DC converter plays an important role in the powerplant of the FCHV because DC-DC converter can control and regulate the energy flow of the FCHV. On top of that, the DC-DC converter receives the signal from the PCU to change the desired output requested by the PCU. Based on the Figure below [1], all the information of the powerplant is sent to the PCU and PCU will send a control signal action to the DC-DC converter. Therefore, an energy management system is required to regulate the energy flow.

[[File:Overview of FCHV.jpg|600px|frameless|center]]

The specification of each of the components in the powerplant of the FCHV is listed as shown below.

'''Fuel Cell Stack'''
*Type of Fuel Cells: PEM
*Number of Cells: 14 cells
*Rated Power: 30W
*Performance: 8.4V/3.6A
'''DC-DC Converter'''
*Input Range: 8-14V
*Output Range: 15-25V, 1.2-2A
'''Battery Pack'''
*Type: Nickel Metal
*Specification: 24V 3000mAh

The system block diagram of the energy flow of the FCHV to demonstrate how the energy flow between the power plant in the vehicle.

[[File:PowerFlow of FCHV.png|600px|frameless|center]]

The total required power formulation can be defined as below:

[[File:Equation.png|800px|frameless|center]]

where Pfs is the output power of the Fuel Cell Stack, Pbo denotes the output power from the battery, PAux denotes the auxiliarites's power, PDC-DC denotes the power output of the DC-DC converter and Prequired denotes the power requried need from the vehicle.

=== '''High Level Design''' ===
[[File:High Level Design.png|500px|center|frameless]]

=== '''Energy Management Strategy Design''' ===

[[File:MDP Bellman.png|500px|center|frameless]]

The optimisation problem is solved by using Markov Decision Process. Since we have driving history from the past, we are using Markov Chain on these set of data to get a transition matrix of the vehicle's power demand. This transition matrix shows the probability of each power demand changes to other power demand. Then, since we are using Markov Chain we proceed to model the optimisation problem by using Markov Decision Process. This is because we are using the probability matrix of driving history to determine the optimal control to regulate the power flow between fuel cell and battery. Markov Decision Process is an algorithm to determine an optimal control based of state of the vehicle and reward function. We determine the state of the vehicle as SoC of the battery. While we determine the reward function as cost function of fuel consumption and SoC deviation from a reference.

Then, we solve the optimisation problem by using Bellman equation based on the figure above. The input is transition matrix of battery SoC, reward function, discount factor and states of the vehicle. The output is optimal current from the fuel cell which will be sent its signal to the DC-DC converter.

=== '''Battery Management System Design''' ===

[[File:Kalman Filter.png|500px|center|frameless]]

=== '''Simulation''' ===

==== '''Power Plant''' ====
The powerplant design simulation using MATLAB/Simulink is shown below:

[[File:Power Plant of FCHV.png|800px|frameless|center]]

The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

==== '''Simulator of the FCHV''' ====
The simulator of the FCHV including the energy management system and battery management system using MATLAB/Simulink is shown below:

[[File:Simulator.png|500px|frameless|center]]

1. Driving behaviour
This is the input of the system. The driving behaviour is translate as a velocity of the vehicle in km/h.

2. Motor
From the velocity of the vehicle, the power request is determined. The parameters of the vehicle such as radius of the wheels, weight of the vehicle are based on the Fuel Cell Hybrid Model.

3. Controller
The controller is the main part of this project where we need to implement the Energy Management Strategy to regulate the power flow between fuel cell and battery. It will determine optimal current command and send the signal to the DC-DC converter in the Power Plant.

4. Power Plant
The Power Plant consists of Fuel cell, battery and DC-DC converter. It will receive signal from the controller to output how many current needed from the fuel cell. Fuel cell and battery will supply the requested power to the motor. A Battery Management System also can found in here where it used to estimate the SoC of the battery. Then the SoC of battery information will be sent back to the controller.

== '''Result & Discussion''' ==

=== '''Performance of Energy Management Strategy''' ===
The performance of the PCU was compared with Rule-based strategy in terms of total hydrogen fuel consumption, battery SoC.

{| class="wikitable"
|+ Predetermined rules set by the team
|-
! Power demand
! SoC battery
! Condition
! Current command, A
|-
| Negative
| SoC < 40
| Regenerative braking
| 0
|-
| Negative
| 40 < SoC < 60
| Regenerative braking
| 0
|-
| Negative
| SoC > 60
| Regenerative braking
| 0
|-
| Zero
| SoC < 40
| Fuel cell charges the battery
| 3
|-
| Zero
| 40 < SoC < 60
| Fuel cell charges the battery
| 2
|-
| Zero
| SoC > 60
| No power flow
| 0
|-
| Positive
| SoC < 40
| Fuel cell mode
| 4 (maximum)
|-
| Positive
| 40 < SoC < 60
| Hybrid mode
| 2
|-
| Positive
| SoC > 60
| Battery mode
| 0
|}

[[File:Fuel Consumption .jpg|800px|frameless|center|Figure 6: Comparison of Fuel Consumption with MDP and Ruled-Based]]

[[File:Total fuel consumption.png|800px|frameless|center|Total fuel consumption]]

[[File:SOC vs Time.jpg|800px|frameless|center]]

The MDP strategy consumes more hydrogen fuel at the start to reach the SoC reference faster compared to rule-based strategy. Then it will maintain the SoC at the reference which is 50%. Using the same driving cycle, the total fuel consumption for MDP strategy is lower than rule-based strategy.

=== '''Performance of Battery Management System''' ===

[[File:Kalman Filter Results.jpg|600px|frameless|center]]

The analyse the performance of the our Battery Management Strategy, we compared the estimation SoC by Kalman Filter with real SoC reading from the battery model. The estimation curve has small value of deviation with the real SoC reading. This can ensure the control action determined by the PCU is accurate and correct.

=='''Conclusion & Future Work'''==
The controller was developed by implementing a Markov Decision Process as the strategy. The Battery Management System was introduced the application of Extended Kalman Filter. The fully functional simulator was developed in Simulink to analyse the performance of the controller and the Battery Management System. This proposed strategy is accepted to continue its development by implementing it to the actual model of Fuel Cell Hybrid Vehicle which is shown below. This strategy can be improved more by using online optimisation problem solving which can be more robust compared to offline.

[[File:FCHV.jpg|400px|frameless|center]]

=='''Reference'''==
:'''[1]''' D. Shen, “Week 1 Presentation,” in Project introduction, 06-Jun-2019.
:'''[2]''' A. L. Dicks, D. A. J. Rand, and J. Larminie, Fuel cell systems explained. Chichester: Wiley, 2018.
:'''[3]''' Y. Huang, H. Wang, A. Khajepour, H. He, and J. Ji, “Model predictive control power management strategies for HEVs: A review,” Journal of Power Sources, vol. 341, pp. 91–106, 2017.
:'''[4]''' K. Simmons, Y. Guezennec, and S. Onori, “Modeling and energy management control design for a fuel cell hybrid passenger bus,” Journal of Power Sources, vol. 246, pp. 736–746, 2014.

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:27:07Z

A1684007: /* Energy Management Strategy Design */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:26:53Z

A1684007: /* High Level Design */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:12:09Z

A1684007: /* Power Plant */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:11:31Z

A1684007: /* Methodology */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T09:06:21Z

A1684007:

File:Equation.png

2019-10-29T09:06:06Z

A1684007:

equation

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:57:46Z

A1684007: /* Methodology */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:57:12Z

A1684007: /* Methodology */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:55:56Z

A1684007: /* Power Plant */

File:PowerFlow of FCHV.png

2019-10-29T08:55:35Z

A1684007:

Power Flow of FCHV

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:53:24Z

A1684007: /* Simulation */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:52:12Z

A1684007: /* Aim */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:51:30Z

A1684007: /* Why Fuel Cell Hybrid Vehicle? */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:48:42Z

A1684007: /* Fuel Cell Hybrid Vehicle */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:46:05Z

A1684007: /* Aim */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:45:35Z

A1684007: /* Aim */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:44:52Z

A1684007: /* Aim */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:44:11Z

A1684007: /* Energy Management Strategy Design */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:44:01Z

A1684007: /* High Level Design */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:43:05Z

A1684007: /* Performance of Battery Management System */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:42:39Z

A1684007: /* Power Plant */

Projects:2019s1-131 Fuel Cell Hybrid Vehicle: Energy Management and AI-Enable Intelligent Control

2019-10-29T08:42:21Z

A1684007: /* Power Plant */