A. Pottier, F. Socheleau, and C. Laot, Quality-of-Service Satisfaction Games for Noncooperative Underwater Acoustic Communications, IEEE Access, Special Issue : Underwater Wireless Communications and Networking, vol.6, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01761481

A. Pottier, F. Socheleau, and C. Laot, Robust Noncooperative Spectrum Sharing Game in Underwater Acoustic Interference Channels, IEEE Journal of Oceanic Engineering, vol.42, issue.4, pp.1019-1034, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01630275

A. Pottier, P. D. Mitchell, F. Socheleau, and C. Laot, Q-Learning Based Adaptive Channel Selection for Underwater Sensor Networks, Underwater Communications and Networking Conference (UComms), 2018.
URL : https://hal.archives-ouvertes.fr/hal-01891656

A. Pottier, F. Socheleau, and C. Laot, Power-Efficient Spectrum Sharing for Noncooperative Underwater Acoustic Communication Systems, IEEE OCEANS, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01424511

A. Pottier, F. Socheleau, and C. Laot, Adaptive Power Allocation for Noncooperative OFDM Systems in UWA Interference Channels, Underwater Communications and Networking Conference (UComms), 2016.
URL : https://hal.archives-ouvertes.fr/hal-01514722

A. Pottier, F. Socheleau, and C. Laot, Distributed Power Allocation Strategy in Shallow Water Acoustic Interference Channels, IEEE Signal Processing Advances for Wireless Comms. (SPAWC), 2016.
URL : https://hal.archives-ouvertes.fr/hal-01369655

F. Socheleau, A. Pottier, and C. Laot, Stochastic Replay of SIMO Underwater Acoustic Communication Channels, IEEE OCEANS, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01343440

, est meilleure à mesure que le facteur de Rice devient grand, les trois inégalités devenant des égalités lorsque g i,n = 1 -ce qui se vérifie asymptotiquement lorsque K i,n ? +?. En termes physiques, cela signifie que l'approximation est valide dans des canaux de Rice dont la composante spéculaire a une puissance forte devant la composante diffusée. Des sondages en mer de canaux ASM petits fonds font état de facteurs de Rice élevés -plusieurs dizaines de décibels -pour les trajets les plus énergétiques, dans la forme donnée par l'équation (A.17), 2011.

E. Bibliographie, Z. Altman, and . Altman, S-Modular Games and Power Control in Wireless Networks, IEEE Trans. on Automatic Control, vol.48, 2003.

A. J. Anandkumar, A. Anandkumar, S. Lambotharan, and J. A. Chambers, Robust Rate Maximization Game Under Bounded Channel Uncertainty, IEEE Trans. Vehicular Technologies, vol.60, issue.9, pp.4471-4486, 2011.

P. Anjangi and M. Chitre, Model-based Data-driven Learning Algorithm for Tuning an Underwater Acoustic Link, Proceedings of the 4th Underwater Communications and Networking Conference (Ucomms), 2018.

R. J. Aumann, Correlated Equilibrium as an Expression of Bayesian Rationality, Econometrica, vol.55, issue.1, pp.1-18, 1986.

R. , J. D. Aumann, and M. B. Maschler, Repeated Games with Incomplete Information, 1995.

Y. Aval, S. K. Wilson, and M. Stojanovic, On the Achievable Rate of a Class of Acoustic Channels and Practical Power Allocation Strategies for OFDM Systems, IEEE J. of Oceaninc Eng, vol.40, issue.4, pp.785-795, 2015.

G. Bacci, S. Lasaulce, W. Saad, and L. Sanguinetti, Game Theory for Networks : A tutorial on game-theoretic tools for emerging signal processing applications, IEEE Signal Processing Magazine, vol.33, issue.1, pp.94-119, 2016.

A. Baggeroer, Acoustic telemetry -An overview, IEEE Journal of Oceanic Engineering, vol.9, issue.4, pp.229-235, 1984.

N. Baldo, P. Casari, and M. Zorzi, Cognitive Spectrum Access for Underwater Acoustic Communications, Proc. MTS/IEEE OCEANS 2008, 2008.

E. Bejjani and J. C. Belfiore, Multicarrier coherent communications for the underwater acoustic channel, OCEANS 96 MTS/IEEE Conference Proceedings. The Coastal Ocean -Prospects for the 21st Century, vol.3, pp.1125-1130, 1996.

R. E. Bellman, Dynamic Programming, 1957.

P. Bello, Characterization of Randomly Time-Variant Linear Channels, IEEE Transactions on Communications Systems, vol.11, issue.4, pp.360-393, 1963.

E. V. Belmega, S. Lasaulce, and M. Debbah, Power allocation games for MIMO multiple access channels with coordination, IEEE Transactions on Wireless Communications, vol.8, issue.6, pp.3182-3192, 2009.
URL : https://hal.archives-ouvertes.fr/hal-00446971

C. R. Berger, S. Zhou, J. C. Preisig, and P. Willett, Sparse Channel Estimation for Multicarrier Underwater Acoustic Communication : From Subspace Methods to Compressed Sensing, IEEE Transactions on Signal Processing, vol.58, issue.3, pp.1708-1721, 2010.

R. A. Berry and D. Tse, Shannon Meets Nash on the Interference Channel, IEEE Transactions on Information Theory, vol.57, issue.5, pp.2881-2835, 2011.

D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation : Numerical Methods, 1997.

M. Biagi, A. Petroni, S. Colonnese, R. Cusani, and G. Scarano, On Rethinking Cognitive Access for Underwater Acoustic Communications, IEEE Journal of Oceanic Engineering, vol.41, issue.4, pp.1045-1060, 2016.

E. Biglieri, J. Proakis, and S. Shamai, Fading channels : information-theoretic and communications aspects, IEEE Transactions on Information Theory, vol.44, issue.6, pp.2619-2692, 1998.
DOI : 10.1109/18.720551

P. Casari and M. Zorzi, Protocol Design Issues in Underwater Acoustic Networks, Computer Communications, vol.34, 2011.

S. E. Cho, H. C. Song, and W. S. Hodgkiss, Successive Interference Cancellation for Underwater Acoustic Communications, IEEE J. of Oceaninc Eng, vol.36, issue.4, pp.490-501, 2011.
DOI : 10.1109/joe.2011.2158014

S. E. Cho, H. C. Song, and W. S. Hodgkiss, Asynchronous multiuser underwater acoustic communications, The Journal of the Acoustical Society of America, vol.132, issue.1, pp.5-8, 2012.
DOI : 10.1121/1.4726029

Y. Chu, S. Konusalp, P. D. Mitchell, D. Grace, and T. Clarke, Application of reinforcement learning to medium access control for wireless sensor networks, Eng. Applications of Artificial Intelligence, vol.46, pp.23-32, 2015.

C. Clay and H. Medwin, Fundamentals of Acoustical Oceanography, 1998.

R. F. Coates, Noise and Reverberation. Macmillan New Electronics Series, 1990.
DOI : 10.1007/978-1-349-20508-0_6

A. A. Cournot, Recherches sur les principes de la théorie des richesses, 1838.

T. M. Cover and J. A. Thomas, Elements of Information Theory, 2006.

B. Dunshaw, Worldwide Sound Speed, Temperature, Salinity, and Buoyancy from the NOAA World Ocean Atlas

F. Facchinei and C. Kanzow, Generalized Nash Equilibrium Problems, vol.4, pp.173-210, 2007.
DOI : 10.1007/s10479-009-0653-x

F. Fazel, M. Fazel, and M. Stojanovic, Random Access Compressed Sensing for EnergyEfficient Underwater Sensor Networks, IEEE J. on Selected Areas in Communications, vol.29, issue.8, pp.1660-1670, 2011.
DOI : 10.1109/jsac.2011.110915
URL : http://faculty.washington.edu/mfazel/JSAC2011.pdf

F. Fazel, M. Fazel, and M. Stojanovic, Random Access Compressed Sensing over Fading and Noisy Communication Channel, IEEE Trans. on Wireless Communications, vol.12, issue.5, pp.2114-2125, 2013.
DOI : 10.1109/twc.2013.032013.120489
URL : http://faculty.washington.edu/mfazel/fatemeh-twc.pdf

N. Feng, S. Mau, and N. B. Mandayam, Pricing and power control for joint networkcentric and user-centric radio resource management, IEEE Transactions on Communications, vol.52, issue.9, pp.1547-1557, 2004.
DOI : 10.1109/tcomm.2004.833191

D. Fudenberg and D. K. Levine, The Theory of Learning in Games, 1998.

D. Fudenberg and J. Tirole, Game Theory, 1991.

R. G. Gallager, Principles of Digital Communications, 2008.

V. Benoit-geller, G. Capellano, and . Jourdain, Equalizer for real time high rate transmission in underwater communications, 1995 International Conference on Acoustics, Speech, and Signal Processing, ICASSP '95, pp.3179-3182, 1995.

M. Goonewardena, S. M. Perlaza, A. Yadav, and W. Ajib, Generalized Satisfaction Equilibrium for Service-Level Provisioning in Wireless Networks, IEEE Trans. on Communications, vol.65, issue.6, pp.2427-2437, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01541234

Z. Han, D. Niyato, W. Saad, T. Basar, and A. Hjorungnes, Game Theory in Wireless and Communication Networks, 2012.

C. Hasan, E. Altman, J. Gorce, and M. Haddad, Non-Cooperative Association Of Mobiles To Access Points Revisited, WiOpt'12 : Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00763628

S. Hayashi and Z. Luo, Spectrum Management for Interference-Limited Multiuser Communication Systems, IEEE Trans. on Information Theory, vol.55, issue.3, pp.1153-1175, 2009.

G. He, M. Debbah, and S. Lasaulce, K-player Bayesian waterfilling game for fading multiple access channels, 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), pp.17-20, 2009.

G. He, M. Debbah, and E. Altman, A Bayesian Game-Theoretic Approach for Distributed Resource Allocation in Fading Multiple Access Channels, EURASIP Journal on Wireless Communications and Networking, issue.1, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00784439

J. Hu and M. P. Wellman, Multiagent reinforcement learning : Theoretical framework and an algorithm, Proceedings of the Fifteenth International Conference on Machine Learning, ICML '98, pp.242-250, 1998.

J. Huang, S. Zhou, and Z. Wang, Performance Results of Two Iterative Receivers for Disitributed MIMO OFDM With Large Doppler Deviations, IEEE Journal of Oceanic Engineering, vol.38, issue.2, pp.347-357, 2013.

J. M. Jornet, M. Stojanovic, and M. Zorzi, On Joint Frequency and Power Allocation in a Cross-Layer Protocol for Underwater Acoustic Networks, IEEE Journal of Oceanic Engineering, vol.35, issue.4, pp.936-947, 2010.

D. Kilfoyle and A. Baggeroer, The State of the Art in Underwater Acoustic Telemetry, IEEE J. of Oceaninc Eng, vol.25, issue.1, pp.4-27, 2000.

V. O. Knudsen, R. S. Alford, and J. W. Emling, Underwater Ambient Noise, Journal of Maritime Research, 1948.

S. Konusalp, Y. Chu, P. D. Mitchell, D. Grace, and T. Clarke, Use of Q-learning approaches for practical medium access control in wireless sensor networks, Eng. Applications of Artificial Intelligence, vol.55, pp.146-154, 2016.

C. Laot and R. Lebidan, Adaptive MMSE turbo equalization with high-order modulations and spatial diversity applied to underwater acoustic communications, 17th European Wireless 2011 -Sustainable Wireless Technologies, pp.1-6, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00673282

A. Lapidoth and S. M. Moser, Capacity Bounds via Duality with Applications to Multiple-Antenna Systems on Flat-Fading Channels, IEEE Trans. Information Theory, vol.49, issue.10, pp.2426-2467, 2003.

S. Lasaulce and H. Tembine, Game Theory and Learning for Wireless Networks, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00661625

J. Z. Leibo, V. Flores-zambaldi, M. Lanctot, J. Marecki, and T. Graepel, Multi-agent Reinforcement Learning in Sequential Social Dilemmas, 2017.

A. Lesherm and E. Zehavi, Game Theory and the Frequency Selective Interference Channel, IEEE Signal Processing Mag, vol.26, pp.28-40, 2009.

K. Leyton-brown and Y. Shoham, Multiagent Systems : Algorithmic, Game-Theoretic, and Logical Foundations, 2009.

B. Li, J. Huang, S. Zhou, K. Ball, M. Stojanovic et al., MIMO-OFDM for High-Rate Underwater Acoustic Communications, IEEE Journal of Oceanic Engineering, vol.34, issue.4, pp.634-644, 2009.

M. L. Littman, Markov games as a framework for multi-agent reinforcement learning, Proceedings of the Eleventh International Conference on International Conference on Machine Learning, ICML'94, pp.157-163, 1994.

G. Loubet, B. Lacoume, F. Faure, and . Vial, Effet de la dispersion sur la propagation acoustique sous marine, Colloque de Physique, vol.51, issue.C2, pp.945-948, 1990.
URL : https://hal.archives-ouvertes.fr/jpa-00230546

X. Lurton, Acoustique sous-marine : présentation et applications. Ifremer, Bibliothèque de Brest, 1998.

X. Lurton, An Introduction to Underwater Acoustics : Principles and Applications, 2011.

A. Mahmood, M. Chitre, and M. A. Armand, PSK Communication with Passband Additive Symmetric alpha-Stable Noise, IEEE Transactions on Communications, vol.60, issue.10, pp.2990-3000, 2012.

J. Maynard-smith and G. R. Price, The Logic of Animal Conflict, Nature, vol.246, pp.15-19, 1973.

E. Mccarthy, International Regulation Of Underwater Sound : Establishing Rules and Standards to Address Ocean Noise Pollution, 2004.

J. Mcgee, J. Catipovic, S. Schoenecker, and P. Swaszek, Leveraging spatial diversity to mitigate partial band interference in undersea networks through waveform reconstruction, Proc. MTS/IEEE OCEANS 2014 -St John's, pp.1-8, 2014.

P. Mertikopoulos, E. V. Belmega, A. L. Moustakas, and S. Lasaulce, Distributed Learning Policies for Power Allocation in Multiple Access Channels, IEEE J. Selected Areas on Communications, vol.30, issue.1, pp.96-106, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00648840

J. Mitola, Cognitive Radio : an integrated agent architecture for software defined radio, 2000.

M. Molins and M. Stojanovic, Slotted FAMA : a MAC protocol for underwater acoustic networks, OCEANS 2006 -Asia Pacific, pp.1-7, 2006.

D. Monderer and L. S. Shapley, Potential games, Games and Economic Behavior, vol.14, issue.1, pp.124-143, 1996.

N. Morozs, T. Clarke, and D. Grace, Cognitive spectrum management in dynamic cellular environments : A case-based Q-learning approach, Eng. Applications of Artificial Intelligence, vol.55, pp.239-249, 2016.

A. S. Motahari and A. K. Khandani, Capacity Bounds for the Gaussian Interference Channel, IEEE Transactions on Information Theory, vol.55, issue.2, pp.620-643, 2009.

F. Mériaux, S. M. Perlaza, S. Lasaulce, Z. Han, and V. Poor, Achievability of Efficient Satisfaction Equilibria in Self Configuring Networks, Int. Conf. on Game Theory for Networks (GameNets) 2012, pp.1-15, 2012.

, National Academy of Sciences NAS. Present and Future Civil Uses of Underwater Sound, 1970.

J. Nash, The Bargaining Problem, Econometrica, vol.18, issue.2, pp.155-162, 1950.

J. F. Nash, Non Cooperative Games, vol.54, pp.286-295, 1951.

, JANUS, the CMRE underwater communications protocol becomes a NATO Standard, 2017.

Y. Noam, A. Leshem, and H. Messesr, A Rayleigh Fading Interference Game with Incomplete Information, 2010 IEEE Sensor Array and Multichannel Signal Processing Workshop, pp.49-52, 2010.

M. J. Osborne and A. Rubinstein, A Course in Game Theory, 1994.

R. Otnes, A. Asterjadhi, P. Casari, M. Goetz, T. Husoy et al., Underwater Acoustic Networking Techniques, 2012.

J. S. Pang, G. Scutari, F. Facchinei, and C. Wang, Distributed Power Allocation With Rate Constraints in Gaussian Parallel Interference Channels, IEEE Trans. on Information Theory, vol.54, issue.8, pp.3471-3489, 2008.

S. M. Perlaza, H. Tembine, S. Lasaulce, and M. Debbah, Quality-of-Service Provisioning in Decentralized Networks : A Satisfaction Equilibrium Approach, IEEE J. of Selected Topics in Signal Processing, pp.104-116, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00769411

M. B. Porter, The BELLHOP Manual and Users Guide : Preliminary draft. Heat, 2011.

J. Potter, J. Alves, D. Green, G. Zappa, I. Nissen et al., The JANUS underwater communication standard, Proc. 1st Underwater Communications and Networking Conf. (Ucomms), pp.1-4, 2014.

A. Pottier, F. Socheleau, and C. Laot, Power-Efficient Spectrum Sharing for Noncooperative Underwater Acoustic Communication Systems
URL : https://hal.archives-ouvertes.fr/hal-01424511

S. Monterey, , 2016.

A. Pottier, F. Socheleau, and C. Laot, Distributed Power Allocation Strategy in Shallow Water Acoustic Interference Channels, IEEE Int. workshop on Signal Processing Advances in Wireless Communications (SPAWC) 2016, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01369655

A. Pottier, F. Socheleau, and C. Laot, Adaptive Power Allocation for Noncooperative OFDM Systems in UWA Interference Channels, Proc. 3rd Underwater Acoustic Communications and Networking Conf. (UComms), 2016.
URL : https://hal.archives-ouvertes.fr/hal-01514722

A. Pottier, F. Socheleau, and C. Laot, Robust Noncooperative Spectrum Sharing Games in Underwater Acoustic Interference Channels, IEEE J. of Oceanic Eng, vol.42, issue.4, pp.1019-1034, 2017.

A. Pottier, P. D. Mitchell, F. Socheleau, and C. Laot, Q-Learning based Adaptive Channel Selection for Underwater Sensor Networks, Proc. 4th Underwater Acoustic Communications and Networking Conf. (UComms), 2018.
URL : https://hal.archives-ouvertes.fr/hal-01891656

A. Pottier, F. Socheleau, and C. Laot, Quality-of-Service Satisfaction Games for Noncooperative Underwater Acoustic Communications, IEEE Access, vol.6, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01761481

J. G. , Proakis. Digital Communications. McGraw-Hill, 2001.

P. Qarabaqi and M. Stojanovic, Adaptive power control for underwater acoustic communications, OCEANS 2011 IEEE -Spain, pp.1-7, 2011.

P. Qarabaqi and M. Stojanovic, Modeling the large scale transmission loss in underwater acoustic channels, 49th Annual Allerton Conf. on Communication, Control, and Computing (Allerton), pp.445-452, 2011.

P. Qarabaqi and M. Stojanovic, Statistical Characterization and Computationally Efficient Modeling of a Class of Underwater Acoustic Communication Channels, IEEE J. Ocean. Eng, vol.38, issue.4, pp.701-717, 2013.

A. Radosevic, T. M. Duman, J. G. Proakis, and M. Stojanovic, Channel prediction for adaptive modulation in underwater acoustic communications, OCEANS 2011 IEEE -Spain, pp.1-5, 2011.

A. Radosevic, R. Ahmed, T. M. Duman, J. G. Proakis, and M. Stojanovic, Adaptive OFDM Modulation for Underwater Acoustic Communications : Design Considerations and Experimental Results, IEEE J. of Oceaninc Eng, vol.39, issue.2, pp.357-370, 2014.

J. B. Rosen, Existence and Uniqueness of Equilibrium Points for Concave N-Persons Games, Econometrica, vol.33, issue.3, pp.521-534, 1965.

S. Ross and B. Chaib-draa, Satisfaction Equilibrium : Achieving Cooperation in Incomplete Information Games, Proc. Canadian Conf. on AI, pp.61-72, 2006.

C. U. Saraydar, N. B. Mandayam, and D. J. Goodman, Efficient power control via pricing in wireless data networks, IEEE Transactions on Communications, vol.50, issue.2, pp.291-303, 2002.

D. A. Schmidt, C. Shi, R. A. Berry, M. L. Honig, and W. Utschick, Distributed resource allocation schemes : Pricing algorithms for power control and beamformer design in interference networks, IEEE Signal Processing Magazine, vol.26, issue.5, pp.53-63, 2009.

G. Scutari, D. P. Palomar, and S. Barbarossa, Distributed totally asynchronous iterative waterfilling for wideband interference channel with time/frequency offset, IEEE Int. Conf. Acoustics, Speech and Signal Processing, vol.4, 2007.

G. Scutari, D. P. Palomar, and S. Barbarossa, Optimal Linear Precoding Strategies for Wideband Non-Cooperative Systems Based on Game Theory-Part I : Nash Equilibria, IEEE Trans. on Signal Processing, vol.56, issue.3, pp.1230-1249, 2008.

G. Scutari, D. P. Palomar, and S. Barbarossa, Optimal Linear Precoding Strategies for Wideband Non-Cooperative Systems Based on Game Theory-Part II : Algorithms, IEEE Trans. on Signal Processing, vol.56, issue.3, pp.1250-1267, 2008.

G. Scutari, D. P. Palomar, and S. Barbarossa, Asynchronous Iterative Waterfilling for Gaussian Frequency-Selective Interference Channels : A Unified Framework. Transactions on Information Theory, vol.54, pp.2868-2879, 2008.

G. Scutari, F. Facchinei, J. Pang, and D. P. Palomar, Real and Complex Monotone Communication Games, IEEE Trans. on Inform. Theory, vol.60, issue.7, pp.4197-4231, 2014.

B. S. Sharif, J. Neasham, O. R. Hinton, and A. E. Adams, A computationally efficient Doppler compensation system for underwater acoustic communications, IEEE Journal of Oceanic Engineering, vol.25, issue.1, pp.52-61, 2000.

A. C. Singer, J. K. Nelson, and S. S. Kozat, Signal Processing for Underwater Acoustic Communications, IEEE Communications Mag, 2009.

F. Socheleau, C. Laot, and P. , A Maximum Entropy Framework for Statistical Modeling of Underwater Acoustic Communication Channels, MTS/IEEE Oceans 2010, pp.1-7, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00515387

F. Socheleau, C. Laot, and J. Passerieux, Concise Derivation of Scattering Function from Channel Entropy Maximization, IEEE Trans. on Communications, vol.58, issue.11, pp.3098-3103, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00565754

F. Socheleau, C. Laot, and J. Passerieux, Stochastic Replay of non-WSSUS Underwater Acoustic Communication Channels Recorded at Sea, IEEE Trans. Signal Process, vol.59, issue.10, pp.4838-4849, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00640755

F. Socheleau, A. Pottier, and C. Laot, Stochastic Replay of SIMO Underwater Acoustic Communication Channels, OCEANS 2015, pp.1-6, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01343440

E. M. Sozer, M. Stojanovic, and J. G. Proakis, Underwater Acoustic Networks, IEEE J. of Oceanic Eng, vol.25, issue.1, pp.72-83, 2000.

M. Stojanovic and J. Preisig, Underwater Acoustic Communication Channels : Propagation Models and Statistical Characterization, IEEE Communications Mag, 2009.

M. Stojanovic and Z. Zvonar, Multichannel processing of broad-band multiuser communication signals in shallow water acoustic channels, IEEE Journal of Oceanic Engineering, vol.21, issue.2, pp.156-166, 1996.

M. Stojanovic, J. Catipovic, and J. G. Proakis, Adaptive multichannel combining and equalization for underwater acoustic communications, The Journal of the Acoustical Society of America, vol.94, issue.3, pp.1621-1631, 1993.

M. Stojanovic, J. A. Catipovic, and J. G. Proakis, Phase-coherent digital communications for underwater acoustic channels, IEEE Journal of Oceanic Engineering, vol.19, issue.1, pp.100-111, 1994.

M. Stojanovic, J. G. Proarkis, J. A. Rice, and M. D. Green, Spread spectrum underwater acoustic telemetry, OCEANS '98 Conference Proceedings, vol.2, pp.650-654, 1998.

M. Stojanovic, S. Shahabudeen, and M. Chitre, Underwater Acoustic Communications and Networking : Recent advances and future challenges, Marine Technology Society J, vol.42, issue.1, 2008.

R. Sutton and A. Barto, Reinforcement Learning : An Introduction, 1998.

A. A. Syed, W. Ye, and J. Heidemann, T-lohi : A new class of mac protocols for underwater acoustic sensor networks, IEEE INFOCOM 2008 -The 27th Conference on Computer Communications, 2008.

P. L. Tyack, Population biology, social behavior and communication in whales and dolphins, Trends in Ecology and Evolution, vol.1, issue.6, pp.144-150, 1986.

R. J. Urick, Principles of Underwater Sound, 1983.

R. J. Urick, Ambient Noise in the Sea. Undersea technology Warfare Office, Naval Sea Systems Command, Department of the Navy, 1984.

P. Van-walree, Channel sounding for acoustic communications : techniques and shallowwater examples. Norwegian Defence Research Establishment (FFI), 2011.

P. Van-walree and R. Otnes, Ultrawideband Underwater Acoustic Communication Channels, IEEE J. of Oceaninc Eng, vol.38, issue.4, pp.678-688, 2013.

P. Van-walree, P. Jenserud, and M. Smedsrud, A Discrete-Time Channel Simulator Driven by Measured Scattering Functions, IEEE J. Selected Areas in Communications, vol.26, issue.9, pp.1628-1637, 2008.

P. Van-walree, E. Sangfelt, and G. Leus, Multicarrier spread spectrum for covert acoustic communications, OCEANS 2008, pp.1-8, 2008.

P. A. Van-walree and G. Leus, Robust Underwater Telemetry With Adaptive Turbo Multiband Equalization, IEEE Journal of Oceanic Engineering, vol.34, issue.4, pp.645-655, 2009.

T. L. Vincent and J. S. Brown, Evolutionary Game Theory, Natural Selection, and Darwinian Dynamics, 2005.

J. Neumann and O. Morgenstern, Theory of Games and Economic Behaviors, 1944.

C. Wang, Z. Wang, W. Sun, and D. R. Fuhrman, Reinforcement Learning based Adaptive Transmission in Time-Varying Underwater Acoustic Channels, IEEE Access, vol.6, pp.2541-2558, 2018.

F. Wang, M. Krunz, and S. Cui, Price-based spectrum management in cognitive radio networks, IEEE Journal of Selected Topics in Signal Processing, vol.2, issue.1, pp.74-87, 2008.

Z. Wang, S. Zhou, J. Catipovic, and P. Willett, Parameterized Cancellation of PartialBand Partial-Block-Duration Interference for Underwater Acoustic OFDM, IEEE Trans. Signal Processing, vol.60, issue.4, pp.1782-1795, 2012.

Z. Wang, S. Zhou, J. Catipovic, and P. Willett, Asynchronous Multiuser Reception for OFDM in Underwater Acoustic Communications, IEEE Transactions on Wireless Communications, vol.12, issue.3, pp.1050-1061, 2013.

J. C. Christopher, P. Watkins, and . Dayan, Q-learning, Machine Learning, vol.8, pp.279-292, 1992.

G. M. Wenz, Review of Underwater Acoustics Research : Noise. Journal of the Acoustical Society of America, 1972.

T. C. Yang and W. Yang, Performance analysis of direct-sequence spreadspectrum underwater acoustic communications with low signal-to-noise-ratio input signals, The Journal of the Acoustical Society of America, vol.123, issue.2, pp.842-855, 2008.

W. B. Yang and T. C. Yang, High-Frequency Channel Characterization for M-ary Frequency Shift Keying Underwater Acoustic Communications, J. of the Acoustical Society of America, vol.120, issue.5, pp.2615-2626, 2006.

Y. Yang, G. Scutari, D. P. Palomar, and M. Pesavento, A Parallel Decomposition Method for Nonconvex Stochastic Multi-Agent Optimization Problems, IEEE Transactions on Signal Processing, vol.64, issue.11, pp.2949-2964, 2016.

Y. Zhao and G. J. Pottie, Optimal Spectrum Management in Multiuser Interference Channels, IEEE Transactions on Information Theory, vol.59, issue.8, pp.4961-4976, 2013.

S. Zhou and Z. Wang, OFDM for underwater acoustic communications, 2014.