, Define the linguistic variables and terms (initialization)

, Construct the membership functions (initialization)

, Construct the rule base (initialization)

, Convert crisp input data to fuzzy values using the membership functions (fuzzification)

, Evaluate the rules in the rule base

, Combine the results of each rule (inference)

, Convert the output data to non-fuzzy values (defuzzification)

, Their values are words or sentences from a natural language such as "high" and "low, 2.1.1 LINGUISTIC VARIABLES Linguistic variables are the inputs and outputs of the inference block

.. .. Related-works,

.. .. System-model,

.. .. Channel-model,

P. Load and . .. Models, , vol.87

E. Management-of-green-hetnets and .. .. ,

.. .. Two-stage-heuristic,

.. .. Conclusion,

, Telecommunication management; Self-Organizing Networks (SON); Concepts and requirements. Technical Specification (TS) 32.500, 3rd Generation Partnership Project (3GPP), BBBBBBBBBBBB, 2010.

, Radio Frequency (RF) requirements for LTE Pico Node B

A. , Green wireless network optimisation strategies within smart grid environments for Long Term Evolution cellular networks in Malaysia, Renewable Energy, vol.85, pp.157-170, 2016.

. Ameren, Ameren Price Database

H. Jeffrey-g-andrews, M. Claussen, S. Dohler, . Rangan, C. Mark et al., Femtocells: Past, present, and future, IEEE Journal on Selected Areas in Communications, vol.30, issue.3, pp.497-508, 2012.

G. Jeffrey, S. Andrews, W. Buzzi, . Choi, V. Stephen et al., Anthony CK Soong and Jianzhong Charlie Zhang. What will 5G be?, IEEE Journal on selected areas in communications, vol.32, issue.6, pp.1065-1082, 2014.

G. Auer, O. Blume, V. Giannini, I. Godor, E. et al., Magnus Olsson EAB, Dario Sabella TI and Per Skillermark EAB. INFSO-ICT-247733 EARTH D2.3, Energy Efficiency Analysis of the Reference Systems, Areas of Improvements and Target Breakdown, 2010.

G. Auer, V. Giannini, C. Desset, I. Godor, P. Skillermark et al., Oliver Blume and others. How Much Energy is Needed to Run a Wireless Network, 2011.

L. Badia, E. Feltre, and E. Gindullina, A Markov Model Accounting for Charge Recovery in Energy Harvesting Devices, Wireless Communications and Networking Conference Workshops, pp.1-6, 2017.

A. Barre, F. Suard, M. Gérard, M. Montaru, and D. Riu, Statistical Analysis for Understanding and Predicting Battery Degradations in Real-Life Electric Vehicle Use, Journal of Power Sources, vol.245, pp.846-856, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01071585

A. Barré, B. Deguilhem, S. Grolleau, M. Gérard, F. Suard et al., A review on lithium-ion battery ageing mechanisms and estimations for automotive applications, Journal of Power Sources, vol.241, pp.680-689, 2013.

P. Dimitri, A. Bertsekas, M. Biason, and . Zorzi, On the effects of battery imperfections in an energy harvesting device, Computing, Networking and Communications (ICNC), 2016 International Conference on, pp.1-7, 1999.

P. Blasco, D. Gunduz, and M. Dohler, A learning theoretic approach to energy harvesting communication system optimization, IEEE Transactions on Wireless Communications, vol.12, issue.4, pp.1872-1882, 2013.

S. Borenstein, M. Jaske, and A. Rosenfeld, Dynamic pricing, advanced metering, and demand response in electricity markets, 2002.

N. Börlin, Nonlinear Optimization: Overview of methods; the Newton method with line search, 2007.

S. Boyd and L. Vandenberghe, Convex optimization, 2004.

M. Broussely, . Ph, F. Biensan, . Bonhomme, . Ph et al., Main aging mechanisms in Li ion batteries, Journal of Power Sources, vol.146, issue.1-2, pp.90-96, 2005.

D. ]-lucian-busoniu, B. D. Ernst, R. Schutter, and . Babuska, Fuzzy approximation for convergent model-based reinforcement learning, Fuzzy Systems Conference, pp.1-6, 2007.

H. Richard, J. Byrd, C. Gilbert, and J. Nocedal, A trust region method based on interior point techniques for nonlinear programming, Mathematical Programming, vol.89, issue.1, pp.149-185, 2000.

, Cognitive radio and Cooperative strategies for power saving in multi-standard wireless devices -Home page, C2P, pp.2018-2019

F. Cavallaro, A Takagi-Sugeno Fuzzy Inference System for Developing a Sustainability Index of, Biomass. Sustainability, vol.7, issue.9, pp.12359-12371, 2015.

W. Chang, The State of Charge Estimating Methods for Battery: A, Review. ISRN Applied Mathematics, vol.2013, pp.1-7, 2013.

Y. Chia, S. Sun, and R. Zhang, Commission Of The European Communities. Addressing the challenge of energy efficiency through information and communication technologies, IEEE Transactions on Wireless Communications, vol.13, issue.12, pp.6996-7010, 2008.

. Cordoba-arenas, Andrea Cordoba-Arenas et al. A control-oriented lithium-ion battery pack model for plug-in hybrid electric vehicle cycle-life studies and system design with consideration of health management, Journal of Power Sources, vol.279, pp.791-808, 2015.

T. Couture and Y. Gagnon, An analysis of feed-in tariff remuneration models: Implications for renewable energy investment, Energy policy, vol.38, issue.2, pp.955-965, 2010.

D. Domenico, ;. Domenico, E. C. Strinati, and A. Capone, Enabling Green cellular networks: A survey and outlook, Computer Communications, vol.37, pp.5-24, 2014.

D. Domenico, ;. Domenico, E. C. Strinati, and A. Capone, Enabling green cellular networks: A survey and outlook, Computer Communications, vol.37, pp.5-24, 2014.

K. C. Divya and J. Østergaard, Battery energy storage technology for power systems-An overview, Electric Power Systems Research, vol.79, issue.4, pp.511-520, 2009.

A. Dolara, S. Leva, and G. Manzolini, Comparison of different physical models for PV power output prediction, Solar Energy, vol.119, pp.83-99, 2015.

L. Dusonchet and . Telaretti, Comparative economic analysis of support policies for solar PV in the most representative EU countries, Renewable and Sustainable Energy Reviews, vol.42, pp.986-998, 2015.

, Energy aware radio and network technologies -Home page, EARTH, pp.2018-2019

M. Ecker, J. B. Gerschler, J. Vogel, S. Käbitz, F. Hust et al., Development of a lifetime prediction model for lithium-ion batteries based on extended accelerated aging test data, Journal of Power Sources, vol.215, pp.248-257, 2012.

A. Eddahech, O. Briat, and J. Vinassa, Lithium-ion Battery Performance Improvement Based on Capacity Recovery Exploitation, Electrochimica Acta, vol.114, pp.750-757, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00950535

, EPEC. Energy Density Comparison of Size and Weight, pp.2018-2019

X. Fang, S. Misra, G. Xue, and D. Yang, Smart grid-The new and improved power grid: A survey, IEEE communications surveys & tutorials, vol.14, issue.4, pp.944-980, 2012.

H. Farhangi, The path of the smart grid, IEEE power and energy magazine, vol.8, issue.1, 2010.

. Fp7, Seventh framework programme -Home page, pp.2018-2019

S. John-s-thompson, Z. Zhou, and . Niu, Base station sleeping and resource allocation in renewable energy powered cellular networks, IEEE Transactions on Communications, vol.62, issue.11, pp.3801-3813, 2014.

S. Mohinder and . Grewal, Kalman filtering, International Encyclopedia of Statistical Science, pp.705-708, 2011.

H. Hasan-2011a]-ziaul-hasan, . Boostanimehr, K. Vijay, and . Bhargava, Green cellular networks: A survey, some research issues and challenges, IEEE Communications surveys & tutorials, vol.13, issue.4, pp.524-540, 2011.

H. Hasan-2011b]-ziaul-hasan, V. K. Boostanimehr, and . Bhargava, Green Cellular Networks: A Survey, Some Research Issues and Challenges, IEEE Communications Surveys & Tutorials, vol.13, issue.4, pp.524-540, 2011.

C. Ho, Pham Dang Khoa and Pang Chin Ming. Markovian models for harvested energy in wireless communications, Communication Systems (ICCS), 2010 IEEE International Conference on, pp.311-315, 2010.

, Decomposition of Stochastic Power Management for Wireless Base Station in Smart Grid, Kaewpuang 2012] Rakpong Kaewpuang, Dusit Niyato and Ping Wang, vol.1, pp.97-100, 1992.

N. Karmarkar, A New Polynomial-time Algorithm for Linear Programming, Proceedings of the Sixteenth Annual ACM Symposium on Theory of Computing, STOC '84, pp.302-311, 1984.

M. Kadhem and K. , Analytical evaluation of QoS in the downlink of OFDMA wireless cellular networks serving streaming and elastic traffic, IEEE Transactions on Wireless Communications, vol.9, issue.5, 2010.

R. Khalilpour and A. Vassallo, Planning and operation scheduling of PVbattery systems: A novel methodology, Renewable and Sustainable Energy Reviews, vol.53, pp.194-208, 2016.

S. Koenig, R. G. Simmons, P. Komor, and T. Molnar, Complexity analysis of real-time reinforcement learning applied to finding shortest paths in deterministic domains, BACKGROUND PAPER ON DISTRIBUTED RENEW-ABLE ENERGY GENERATION AND INTEGRATION, 1992.

. Koutitas, A review of Energy Efficiency in Telecommunication Networks. Telfor journal, vol.2, issue.1, pp.2-7, 2010.

M. Ku, W. Li, Y. Chen, K. J. Ray, and . Liu, Advances in Energy Harvesting Communications: Past, Present, and Future Challenges, IEEE Communications Surveys & Tutorials, pp.1-1, 2015.
DOI : 10.1109/comst.2015.2497324

A. Kwasinski and A. Kwasinski, Architecture for green mobile network powered from renewable energy in microgrid configuration, Wireless Communications and Networking Conference (WCNC), pp.1273-1278, 2013.
DOI : 10.1109/wcnc.2013.6554747

. Leithon, Renewable energy management in cellular networks: An online strategy based on ARIMA forecasting and a Markov chain model, Wireless Communications and Networking Conference, pp.1-6, 2016.
DOI : 10.1109/wcnc.2016.7564721

J. Leithon, J. Teng, S. Lim, ;. J. Sun, S. Leithon et al., Online Energy Management Strategies for Base Stations Powered by the Smart Grid, IEEE SmartGridComm, pp.199-204, 2013.
DOI : 10.1109/smartgridcomm.2013.6687957

E. Lemaire-potteau and F. Mattera, Arnaud Delaille and Philippe Malbranche. Assessment of storage ageing in different types of PV systems: technical and economical aspects, 23rd European Photovoltaic Solar Energy Conference, pp.2765-2769, 2008.

. Arthur-d-little, Distributed Generation: System Interfaces, an Arthur D. Little White Paper, 1999.

C. Liu and B. Natarajan, Power Management in Heterogeneous Networks with Energy Harvesting Base Stations, Phys. Commun, vol.16, issue.C, pp.14-24, 2015.
DOI : 10.1016/j.phycom.2015.03.001

C. Liu, B. Natarajan-;-xing-luo, J. Wang, M. Dooner, and J. Clarke, Overview of current development in electrical energy storage technologies and the application potential in power system operation, Physical Communication, vol.16, pp.511-536, 2015.

Y. Mao, J. Zhang, and K. Ben-letaief, Grid Energy Consumption and QoS Tradeoff in Hybrid Energy Supply Wireless Networks, IEEE Transactions on Wireless Commununications, vol.15, issue.5, 2016.
DOI : 10.1109/twc.2016.2523981
URL : http://arxiv.org/pdf/1601.07865

N. Michelusi, L. Badia, R. Carli, L. Corradini, and M. Zorzi, Energy management policies for harvesting-based wireless sensor devices with battery degradation, IEEE Transactions on Communications, vol.61, issue.12, pp.4934-4947, 2013.
DOI : 10.1109/tcomm.2013.111113.130022

C. Morris and A. Jungjohann, Will the Energiewende Succeed?, Energy Democracy, pp.379-412, 2016.
DOI : 10.1007/978-3-319-31891-2_14

. Mpoweruk, Lithium Battery Failures

M. Muratori, ;. Nerini, R. Dargaville, M. Howells, and M. Bazilian, Estimating the cost of energy access: The case of the village of, vol.79, pp.385-397, 2010.

D. Wing-kwan-ng, E. S. Lo, and R. Schober, Energy-efficient resource allocation in OFDMA systems with hybrid energy harvesting base station, IEEE Transactions on Wireless Communications, vol.12, issue.7, pp.3412-3427, 2013.

D. Niyato, X. Lu, and P. Wang, Adaptive Power Management for Wireless Base Stations in a Smart Grid Environment, IEEE Wireless Communications, vol.19, issue.6, pp.44-51, 2012.

O. Ozel, K. Tutuncuoglu, and J. Yang, Sennur Ulukus and Aylin Yener. Transmission with energy harvesting nodes in fading wireless channels: Optimal policies, IEEE Journal on Selected Areas in Communications, vol.29, issue.8, pp.1732-1743, 2011.

O. Ozel, K. Shahzad, and S. Ulukus, Optimal energy allocation for energy harvesting transmitters with hybrid energy storage and processing cost, IEEE Transactions on Signal Processing, vol.62, issue.12, pp.3232-3245, 2014.
DOI : 10.1109/tsp.2014.2321733
URL : http://www.ece.umd.edu/~ulukus/papers/journal/ener-harv-hybrid-storage.pdf

S. Bhubaneswari-parida, R. Iniyan, and . Goic, Christophe Pillot. Li-ion battery material market review and forecast 2012-2025, Avicenne Energy, Presentation at 3rd Israeli Power Sources Conference, Hertzlia (Israel), vol.15, pp.1625-1636, 2010.

G. L. Plett, High-Performance Battery-Pack Power Estimation Using a Dynamic Cell Model, IEEE Transactions on Vehicular Technology, vol.53, issue.5, pp.1586-1593, 2004.
DOI : 10.1109/tvt.2004.832408
URL : http://mocha-java.uccs.edu/dossier/research/2004tvt-.pdf

R. Poudineh and T. Jamasb, Distributed generation, storage, demand response and energy efficiency as alternatives to grid capacity enhancement, Energy Policy, vol.67, pp.222-231, 2014.
DOI : 10.1016/j.enpol.2013.11.073
URL : http://dro.dur.ac.uk/12659/1/12659.pdf

F. Rahimi, A. Ipakchi, ;. G. Rami, T. Tran-quoc, N. Hadjsaid et al., Energy Supply for Remote Base Transceiver Stations of Telecommunication, Advanced: Heterogeneous networks, White Paper, vol.1, pp.1916-1921, 2004.

M. Rashid and A. Gupta, Effect of Relaxation Periods Over Cycling Performance of a Li-ion Battery, Journal of The Electrochemical Society, vol.162, issue.2, pp.3145-3153, 2015.

, Renewable energy policy network for the 21st century, pp.2018-2019, 2017.

Y. Riffonneau, F. Bacha, S. Barruel, and . Ploix, Optimal Power Flow Management for Grid Connected PV Systems With Batteries, IEEE Transactions on Sustainable Energy, vol.2, issue.3, pp.309-320, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00732254

Y. Ru, J. Kleissl, S. Martinez-;-shriram-santhanagopalan, Q. Guo, P. Ramadass et al., Review of models for predicting the cycling performance of lithium ion batteries, IEEE Transactions on Sustainable Energy, vol.4, issue.2, pp.620-628, 2006.

Y. Shang, Global search methods for solving nonlinear optimization problems, 1997.

S. Geomodel, Solar Radiation Time Series

S. Richard, A. G. Sutton, and . Barto, Reinforcement Learning: An Introduction, vol.1, 1998.

S. Richard, A. G. Sutton, and . Barto, Reinforcement Learning: An Introduction Second Edition, 2017.

J. Derk, L. Swider, S. Beurskens, J. Davidson, J. Twidell et al., Katarina Vertin and Romualdas Skema. Conditions and costs for renewables electricity grid connection: Examples in, Europe. Renewable Energy, vol.33, issue.8, pp.1832-1842, 2008.

A. Sánchez-muñoz, M. Garcia, and M. Gerlich, Overview of storage technologies, Sensible, pp.2018-2019, 2016.

S. Tombaz, P. Monti, K. Wang, A. Vastberg, M. Forzati et al., Impact of backhauling power consumption on the deployment of heterogeneous mobile networks, Global Telecommunications Conference (GLOBECOM 2011), 2011.

S. Tombaz, P. Monti, F. Farias, M. Fiorani, L. Wosinska et al., Is backhaul becoming a bottleneck for green wireless access networks?, IEEE International Conference on, pp.4029-4035, 2014.

J. Torriti, M. Leach, and P. Devine-wright, Demand side participation: price constraints, technical limits and behavioural risks. The Future of Electricity Demand: Customers, Citizens and Loads. Department of Applied Economics Occasional Papers (69), pp.88-105, 2011.

, Towards real energy-efficient network design -Home page, pp.2018-2019

N. Cong, M. Truong, R. C. Naumann, M. Karl, A. Müller et al., Economics of residential photovoltaic battery systems in Germany: The case of Tesla's Powerwall. Batteries, vol.2, p.14, 2016.

K. Uddin, A. Picarelli, C. Lyness, N. Taylor, and J. Marco, An Acausal Li-Ion Battery Pack Model for, Automotive Applications. Energies, vol.7, issue.9, pp.5675-5700, 2014.

S. Ulukus, A. Yener, E. Erkip, O. Simeone, M. Zorzi et al., Energy harvesting wireless communications: A review of recent advances. Selected Areas in Communications, Ulukus 2015b] Sennur Ulukus, Aylin Yener, vol.33, pp.1-6, 2010.

H. Wang, H. Li, C. Tang, L. Ye, X. Chen et al., Modeling, Metrics, and Optimal Design for Solar Energy-powered Base Station System, EURASIP Journal on Wireless Communications and Networking, vol.2015, issue.1, 2015.

J. Christopher, P. Watkins, and . Dayan, Machine learning, vol.8, issue.3-4, pp.279-292, 1992.

M. Webb, Enabling the low carbon economy in the information age, The Climate Group. London, vol.1, pp.1-1, 2008.

C. ]-yifei-wei, M. Ren, R. Song, A. Yu-;-lotfi, and . Zadeh, The offloading model for green base stations in hybrid energy networks with multiple objectives, International Journal of Communication Systems, vol.29, issue.11, pp.338-353, 1965.

S. Zhang, N. Zhang, S. Zhou, J. Gong, Z. Niu et al., Energyaware traffic offloading for green heterogeneous networks, IEEE Journal on Selected Areas in Communications, vol.34, issue.5, pp.1116-1129, 2016.
DOI : 10.1109/jsac.2016.2520244
URL : http://arxiv.org/pdf/1601.03505

P. Qipeng, J. Zheng, A. Wang, and . Liu, Stochastic optimization for unit commitment-A review, IEEE Transactions on Power Systems, vol.30, issue.4, pp.1913-1924, 2015.