, Définition de la similarité entre une conférence et un chercheur 78

. .. Expérimentations, 79 7.3.2 Nouveaux membres suggérés comparés aux nouveaux membres des CP officiels

. .. Bilan,

, Motivation et problématique Comme introduit précédemment, de nombreux travaux ont montré l'intérêt d'automatiser différentes tâches relatives à l'organisation des conférences, notamment l'attribution des soumissions aux évaluateurs, 2008.

À. Notre-connaissance-;-han, Sur la base des résultats de l'étude présentée dans le chapitre 6, nous proposons dans ce chapitre une approche pour la suggestion de membres de CP. L'approche se base sur la modélisation des données du domaine sous forme de graphe triparti et sur les six indicateurs précédemment définis. Nous définissons une mesure de similarité Conf iguration1 ? ? 1 = ? 2 = ? 3 = ? 4 = ? 5 = ? 6 = 1, très peu de travaux se sont intéressés à la suggestion de membres de comités de programme, vol.46, 2013.

, 05 % 53,05 % 266 62,44 % 41,63 % 288 67,61 % 33,80 % 2012 486 243 50,00 % 50,00 % 273 56,17 % 37,45 % 300 61,73 % 30, vol.86

, 01 % 46,01 % 239 56,10 % 37,40 % 262 61,50 % 30, vol.46, 2011426196.

, 61 % 215 50,47 % 33,65 % 243 57,04 % 28,52 % 2012 486 194 39,92 % 39,92 % 236 48,56 % 32,37 % 262 53,91 % 26,95 % 2013 431 187 43,39 % 43,39 % 221 51,28 % 34,21 % 243 56,38 % 28, Conf iguration7 ?, vol.19, 2011426173.

, 07 % 50,07 % 835 60,25 % 40,16 % 1078 77,78 % 25, vol.46, 2011.

, Conf iguration7 ?, vol.32, 2013.

, Conf iguration7 ?

, Conf iguration7 ?

M. T. Afzal and H. A. Maurer, Expertise Recommender System for Scientific Community, Journal of Universal Computer Science, vol.17, issue.11, p.15, 2011.

C. Avin, Z. Lotker, D. Peleg, and I. Turkel, Social Network Analysis of Program Committees and Paper Acceptance Fairness, ASONAM'15 : Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, p.34, 2015.

K. Balog, L. Azzopardi, and M. De-rijke, Formal models for expert finding in enterprise corpora, SIGIR'06 : Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, p.17, 2006.

K. Balog, T. Bogers, L. Azzopardi, M. De-rijke, and A. Van-den-bosch, Broad expertise retrieval in sparse data environments, SIGIR'07 : Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, p.18, 2007.

K. Balog and M. De-rijke, Determining Expert Profiles (With an Application to Expert Finding), IJCAI'07, Proceedings of the 20th International Joint Conference on Artificial Intelligence, p.14, 2007.

K. Balog and M. De-rijke, Non-local evidence for expert finding, CIKM'08 : Proceedings of the 17th ACM Conference on Information and Knowledge Management, p.18, 2008.

K. Balog, Y. Fang, M. De-rijke, P. Serdyukov, and L. Si, Expertise Retrieval. Foundations and Trends in Information Retrieval, vol.6, p.13, 2012.

J. Bar-ilan, Web of Science with the Conference Proceedings Citation Indexes : The case of computer science, Scientometrics, vol.83, issue.3, p.43, 2010.

C. Bartneck and J. Hu, Scientometric Analysis of the CHI Proceedings, CHI'09 : Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, p.33, 2009.

D. J. Benos, E. Bashari, J. M. Chaves, A. Gaggar, N. Kapoor et al., The ups and downs of peer review, Advances in Physiology Education, vol.31, issue.2, p.91, 2007.

J. Billaut, D. Bouyssou, and P. Vincke, Should you believe in the Shanghai ranking ?-An MCDM view, vol.84, p.32, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00877050

K. D. Bollacker, S. Lawrence, and C. L. Giles, Discovering Relevant Scientific Literature on the Web, IEEE Intelligent Systems, vol.15, issue.2, p.25, 2000.

K. Börner, Atlas of Science : Visualizing What We Know, 2010.

L. Bornmann and W. Marx, The h index as a research performance indicator, European Science Editing, vol.37, issue.3, p.36, 2011.

D. Bouyssou and T. Marchant, Ranking scientists and departments in a consistent manner, Journal of the American Society for Information Science and Technology, vol.62, issue.9, p.32, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00606931

S. Brin and L. Page, The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems, vol.30, p.20, 1998.

G. Cabanac, Accuracy of inter-researcher similarity measures based on topical and social clues, Scientometrics, vol.87, issue.3, 2011.

G. Cabanac, Shaping the landscape of research in Information Systems from the perspective of editorial boards : A scientometric study of 77 leading journals, Journal of the American Society for Information Science and Technology, vol.63, issue.5, pp.977-996, 2012.

G. Cabanac, BIR'15 : Proceedings of the Second Workshop on Bibliometric-enhanced Information, 2015.

, European Conference on Information Retrieval (ECIR 2015) (T. 1344, p.32

G. Cabanac, Interroger le texte scientifique (Habilitation à diriger des recherches, p.31, 2016.

G. Cabanac, G. Hubert, H. D. Tran, C. Favre, and C. Labbé, Un regard lexicoscientométrique sur le défi EGC 2016, EGC'16 : Actes des 16 e journées Extraction, 2016.

, et Gestion des Connaissances, vol.91, pp.4-7

G. Cabanac and T. Preuss, Capitalizing on order effects in the bids of peerreviewed conferences to secure reviews by expert referees, Journal of the American Society for Information Science and Technology, vol.64, issue.2, p.58, 2013.
URL : https://hal.archives-ouvertes.fr/hal-01123585

Y. Cao, J. Liu, S. Bao, and H. Li, Research on Expert Search at Enterprise Track of TREC, TREC'05 : Proceedings of the 14th Text REtrieval Conference. NIST, 2005.

J. Chen and J. A. Konstan, Conference paper selectivity and impact, Communications of the ACM, vol.53, issue.6, p.43, 2010.

Y. Chen, J. Wei, S. Wu, and Y. Hu, A similarity-based method for retrieving documents from the SCI/SSCI database, Journal of Information Science, vol.32, issue.5, p.34, 2006.

I. Collectif, La recherche en systèmes d'information et ses nouvelles frontières, vol.17, p.3, 2012.

N. Craswell, A. P. De-vries, and I. Soboroff, Overview of the TREC 2005 Enterprise Track, TREC'05 : Proceedings of the Fourteenth Text REtrieval Conference. NIST, p.18, 2005.

J. Crowcroft, S. Keshav, and N. Mckeown, Scaling the academic publication process to Internet scale, Communications of the ACM, vol.52, issue.1, p.91, 2009.

D. Bellis and N. , Bibliometrics and Citation Analysis : From the Science Citation Index to Cybermetrics, vol.32, p.31, 2009.

B. De-la-robertie, Y. Pitarch, A. Takasu, and O. Teste, Identifying Authoritative Researchers in Digital Libraries Using External a Priori Knowledge, SAC'17 : Proceedings of the Symposium on Applied Computing, p.35, 2017.

G. Demartini, J. Gaugaz, and W. Nejdl, A Vector Space Model for Ranking Entities and Its Application to Expert Search, ECIR'09 : Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval, pp.189-201, 2009.

. Springer-verlag, , p.16

B. Dom, I. Eiron, A. Cozzi, and Y. Zhang, Graph-based ranking algorithms for e-mail expertise analysis, DMKD@SIGMOD'03 : Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, p.26, 2003.

M. D. Ekstrand, P. Kannan, J. A. Stemper, J. T. Butler, J. A. Konstan et al., Automatically building research reading lists, RecSys'10 : Proceedings of the 2010 ACM Conference on Recommender Systems, p.27, 2010.

H. Fang and C. Zhai, Probabilistic Models for Expert Finding, ECIR'07 : Proceedings of the 29th European Conference on IR Research on Advances in Information Retrieval, p.17, 2007.

Y. Fang, L. Si, and A. P. Mathur, Discriminative models of integrating document evidence and document-candidate associations for expert search, SIGIR'10 : Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, p.18, 2010.

J. Freyne, L. Coyle, B. Smyth, and P. Cunningham, Relative status of journal and conference publications in Computer Science, Communications of the ACM, vol.53, issue.11, p.43, 2010.

E. Garfield, Citation Indexes for Science : A New Dimension in Documentation through Association of Ideas, Science, vol.122, issue.3159, p.32, 1955.

E. Garfield, The History and Meaning of the Journal Impact Factor, Journal of the American Medical Association, vol.295, issue.1, p.32, 2006.

M. Gevers, Scientific performance indicators : A critical appraisal and a countryby-country analysis, Bibliometrics : Use and abuse in the review of research performance, vol.87, pp.43-53, 2014.

. Wenner-gren, International Series, p.32

Y. Gingras, Les dérives de l'évaluation de la recherche : du bon usage de la bibliométrie, Raisons d'agir, p.32, 2014.

S. Han, J. Jiang, Z. Yue, and D. He, Recommending program committee candidates for academic conferences, CompSci@CIKM 2013 : Proceedings of the workshop on Computational scientometrics : theory & applications, vol.77, p.86, 2013.

J. E. Hirsch, An index to quantify an individual's scientific research output, Proceedings of the National Academy of Sciences of the United States of America, vol.102, p.35, 2005.

Z. Huang, ]. Zan, C. , W. Ong, T. Chen et al., A graph-based recommender system for digital library, JCDL'02 : Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, p.25, 2002.

Z. Huang and Y. Qiu, A multiple-perspective approach to constructing and aggregating Citation Semantic Link Network, Future Generation Computer Systems, vol.26, issue.3, p.24, 2010.

W. Jakawat, C. Favre, and S. Loudcher, Graphs enriched by cubes for OLAP on bibliographic networks, International Journal of Business Intelligence and Data Mining, vol.11, issue.1, p.35, 2016.
URL : https://hal.archives-ouvertes.fr/halshs-01384640

M. Jarke, M. C. Pham, and R. Klamma, Evolution of the CAiSE Author Community : A Social Network Analysis, Seminal Contributions to Information Systems Engineering, p.33, 2013.

G. K. Jayasinghe, S. Karimi, and M. Ayre, Evaluation of Retrieval Algorithms for Expertise Search, ADCS'16 : Proceedings of the 21st Australasian Document Computing Symposium, p.14, 2016.

L. Katz, A new status index derived from sociometric analysis, Psychometrika, vol.18, issue.1, p.29, 1953.

É. Kergosien, M. Bessagnet, C. Sallaberry, L. Parc-lacayrelle, A. Royer et al., Un regard lexico-scientométrique sur le défi EGC, EGC'16 : Actes des, p.16, 2016.

M. M. Kessler, Bibliographic coupling between scientific papers, vol.14, p.48, 1963.

M. Khabsa and C. L. Giles, The Number of Scholarly Documents on the Public Web, PLoS ONE, vol.9, issue.5, p.21, 2014.

J. Kim and J. Kim, Rethinking the comparison of coauthorship credit allocation schemes, Journal of Informetrics, vol.9, issue.3, p.62, 2015.

J. M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM, vol.46, issue.5, p.20, 1999.

M. Kosmulski, The order in the lists of authors in multi-author papers revisited, Journal of Informetrics, vol.6, issue.4, p.62, 2012.

P. Küngas, S. Karus, S. Vakulenko, M. Dumas, C. Parra et al., Reverseengineering Conference Rankings : What Does It Take to Make a Reputable Conference, vol.96, p.33, 2013.

N. Lao and W. W. Cohen, Relational retrieval using a combination of pathconstrained random walks, Machine Learning, vol.81, p.27, 2010.

V. Larivière, Bibliométrie, Sciences, technologies et sociétés de A à Z, pp.26-29, 2015.

S. Lawrence, C. L. Giles, and K. D. Bollacker, Digital Libraries and Autonomous Citation Indexing, IEEE Computer, vol.32, issue.6, p.48, 1999.

M. Ley, The DBLP Computer Science Bibliography : Evolution, Research Issues, Perspectives, SPIRE'02 : Proceedings of the 9th international conference on String Processing and Information Retrieval (T. 2476, pp.1-10, 2002.

L. Leydesdorff, L. Bornmann, J. A. Comins, and S. Milojevi?, Citations : Indicators of Quality ? The Impact Fallacy, Frontiers in Research Metrics and Analytics, vol.1, p.32, 2016.

L. Leydesdorff and S. Milojevi?, Scientometrics, International Encyclopedia of the Social & Behavioral Sciences (2 e éd, vol.21, p.31, 2015.

L. Leydesdorff and I. Rafols, Indicators of the interdisciplinarity of journals : Diversity, centrality, and citations, Journal of Informetrics, vol.5, issue.1, p.32, 2011.

S. Liang and M. De-rijke, Formal Language Models for Finding Groups of Experts, Information Processing & Management, vol.52, issue.4, p.19, 2016.

Y. Liang, Q. Li, and T. Qian, Finding Relevant Papers Based on Citation Relations, WAIM'11 : Proceedings of the 12th International Conference on Web-Age Information Management, p.47, 2011.

D. Liben-nowell and J. M. Kleinberg, The link prediction problem for social networks, CIKM'03 : Proceedings of the 2003 ACM CIKM International Conference on Information and Knowledge Management, p.26, 2003.
DOI : 10.1145/956863.956972
URL : http://cs.carleton.edu/faculty/dlibenno/papers/link-prediction/link.pdf

P. Liu, J. Curson, and P. Dew, Use of RDF for expertise matching within academia, Knowledge and Information Systems, vol.8, issue.1, p.24, 2005.

S. Loudcher, W. Jakawat, E. P. Morales, and C. Favre, Combining OLAP and information networks for bibliographic data analysis : A survey, Scientometrics, vol.103, issue.2, p.35, 2015.
DOI : 10.1007/s11192-015-1539-0
URL : https://hal.archives-ouvertes.fr/halshs-01136559

C. Macdonald and I. Ounis, Voting for candidates : adapting data fusion techniques for an expert search task, CIKM'06 : Proceedings of the ACM CIKM International Conference on Information and Knowledge Management, p.16, 2006.
DOI : 10.1007/s10115-007-0105-3

C. Macdonald and I. Ounis, Searching for Expertise : Experiments with the Voting Model, The Computer Journal, vol.52, issue.7, p.16, 2009.
DOI : 10.1093/comjnl/bxm112

C. Macdonald and I. Ounis, Learning Models for Ranking Aggregates, ECIR'11 : Proceedings of the 33rd European Conference on Research Advances in Information Retrieval, p.19, 2011.
DOI : 10.1007/978-3-642-20161-5_52
URL : http://www.dcs.gla.ac.uk/%7Ecraigm/publications/macdonald11learned.pdf

T. Marchant, Score-based bibliometric rankings of authors, Journal of the American Association for Information Science and Technology, vol.60, issue.6, p.32, 2009.
DOI : 10.1002/asi.21059

D. W. Mcdonald and M. S. Ackerman, Expertise recommender : a flexible recommendation system and architecture, CSCW'00 : Proceeding on the ACM Conference on Computer Supported Cooperative Work, p.24, 2000.

R. K. Merton, The Matthew Effect in Science : The reward and communication systems of science are considered, Science, vol.159, issue.3810, p.4, 1968.

R. K. Merton, The Sociology of Science : Theoretical and Empirical Investigations, p.102, 1973.

C. Moreira, P. Calado, and B. Martins, Learning to Rank Academic Experts in the DBLP Dataset, Expert Systems, vol.32, issue.4, p.35, 2015.
DOI : 10.1111/exsy.12062
URL : http://arxiv.org/pdf/1501.05132

V. V. Nalimov and Z. M. Mulchenko, Naukometriya. Izuchenie Razvitiya Nauki kak Informatsionnogo Protsessa [Scientometrics. Study of the Development of Science as an Information Process, Foreign Technology Division. U.S. Air Force Systems Command, 1969.

, Moscou : Nauka, issue.2

H. Nanba and M. Okumura, Towards Multi-paper Summarization Using Reference Information, IJCAI'99 : Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, p.24, 1999.

D. Nicholas, E. Herman, H. R. Jamali, B. Rodríguez-bravo, C. Boukacem-zeghmouri et al., New ways of building, showcasing, and measuring scholarly reputation, Learned Publishing, vol.28, issue.3, p.93, 2015.
DOI : 10.1087/20150303
URL : https://onlinelibrary.wiley.com/doi/pdf/10.1087/20150303

D. Petkova and W. Croft, Hierarchical Language Models for Expert Finding in Enterprise Corpora, ICTAI'06 : Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence, p.17, 2006.
DOI : 10.1109/ictai.2006.63
URL : http://ciir.cs.umass.edu/pubfiles/ir-527.pdf

D. Petkova and W. B. Croft, Proximity-based document representation for named entity retrieval, CIKM'07 : Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, p.17, 2007.
DOI : 10.1145/1321440.1321542
URL : http://maroo.cs.umass.edu/pub/web/getpdf.php?id=720

D. Pradhan, P. S. Paul, U. Maheswari, S. Nandi, and T. Chakraborty, C 3-index : A PageRank Based Multi-faceted Metric for Authors' Performance Measurement, 2017.
DOI : 10.1007/s11192-016-2168-y

, Scientometrics, vol.110, issue.1, p.35

D. J. Price, Quantitative Measures of the Development of Science, Archives Internationales d'Histoire des Sciences, vol.4, p.31, 1951.

S. Price and P. A. Flach, Computational Support for Academic Peer Review : A Perspective from Artificial Intelligence, Communications of the ACM, vol.60, issue.3, p.77, 2017.

A. Pritchard, Statistical bibliography or bibliometrics ? [Documentation notes, Journal of Documentation, vol.25, issue.4, pp.348-349, 1969.

D. R. Radev, M. T. Joseph, B. Gibson, and P. Muthukrishnan, A bibliometric and network analysis of the field of computational linguistics, Journal of the Association for Information Science and Technology, vol.67, issue.3, p.28, 2016.

D. R. Radev, P. Muthukrishnan, V. Qazvinian, and A. Abu-jbara, The ACL anthology network corpus, Language Resources and Evaluation, vol.47, issue.4, p.28, 2013.

P. Ratinaud, IRaMuTeQ : Interface de R pour les Analyses Multidimensionnelles de Textes et de Questionnaires, 2009.

S. Ribas, B. Ribeiro-neto, R. L. Santos, E. De-souza-e-silva, A. Ueda et al., Random Walks on the Reputation Graph, ICTIR'15 : Proceedings of the 2015 International Conference on The Theory of Information Retrieval, p.35, 2015.

I. S. Ribeiro, R. L. Santos, M. A. Gonçalves, and A. H. Laender, On Tag Recommendation for Expertise Profiling : A Case Study in the Scientific Domain, WSDM'15 : Proceedings of the 8th ACM International Conference on Web Search and Data Mining, p.15, 2015.

M. A. Rodriguez and J. Bollen, An algorithm to determine peer-reviewers, CIKM'08 : Proceedings of the 17th ACM Conference on Information and Knowledge Management, p.77, 2008.

S. Sakr and M. Alomari, A decade of database conferences : A look inside the program committees, Scientometrics, vol.91, issue.1, p.33, 2012.

P. Serdyukov, S. Chernov, and W. Nejdl, Enhancing Expert Search Through Query Modeling, ECIR'07 : Proceedings of the 29th European Conference on Research Advances in Information Retrieval, p.17, 2007.

P. Serdyukov and D. Hiemstra, Modeling Documents as Mixtures of Persons for Expert Finding, ECIR'08 : Proceedings of the 30th European Conference on Research Advances in Information Retrieval, pp.309-320, 2008.

P. Serdyukov, H. Rode, and D. Hiemstra, Modeling multi-step relevance propagation for expert finding, CIKM'08 : Proceedings of the 17th ACM Conference on Information and Knowledge Management, p.47, 2008.

P. Serdyukov, M. Taylor, V. Vinay, M. Richardson, and R. W. White, Automatic People Tagging for Expertise Profiling in the Enterprise, ECIR'11 : Proceedings of the 33rd European Conference on Research Advances in Information Retrieval, pp.399-410, 2011.

G. A. Sfyris, N. Fragkos, and C. Doulkeridis, Profile-Based Selection of Expert Groups, TPDL'16 : Proceedings of the Conference on Theory and Practice of Digital Libraries, vol.77, p.86, 2016.

A. Sinha, Z. Shen, Y. Song, H. Ma, D. Eide et al., An Overview of Microsoft Academic Service (MAS) and Applications, WWW'15 : Proceedings of the 24th International Conference on World Wide Web Companion, p.35, 2015.

H. Small, Co-citation in the scientific literature : A new measure of the relationship between two documents, Journal of the American Society for Information Science, vol.24, issue.4, p.48, 1973.

T. Strohman, W. B. Croft, and D. D. Jensen, Recommending citations for academic papers, SIGIR'07 : Proceedings of the 30th Annual International ACM Conference on Research and Development in Information Retrieval, p.26, 2007.

J. Tang, J. Zhang, L. Yao, J. Li, L. Zhang et al., ArnetMiner : Extraction and mining of academic social networks, SIGKDD'08 Proceedings of the 14th ACM International Conference on Knowledge Discovery and Data Mining, p.27, 2008.

R. Todeschini and A. Baccini, Handbook of bibliometric indicators : Quantitative tools for studying and evaluating research, p.32, 2016.

H. D. Tran, G. Cabanac, and G. Hubert, Suggestion d'experts pour renouveler le comité de programme d'une conférence, CORIA'16 : Actes de la 13 e conférence en recherche d'information et applications, p.92, 2016.

H. D. Tran, G. Cabanac, and G. Hubert, Expert suggestion for conference program committees, RCIS'17 : Proceedings of the 11th International Conference on Research Challenges in Information Science, p.92, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01873803

G. Van-hooydonk, Fractional counting of multiauthored publications : Consequences for the impact of authors, Journal of the American Society for Information Science, vol.48, issue.10, p.62, 1997.

B. Vasilescu, A. Serebrenik, T. Mens, M. G. Van-den-brand, and E. Pek, How healthy are software engineering conferences ? Science of Computer Programming, vol.89, p.34, 2014.

L. Waltman and N. J. Van-eck, The inconsistency of the h-index, Journal of the American Society for Information Science and Technology, vol.63, issue.2, p.36, 2012.

Y. Wang, Y. Tong, and M. Zeng, Ranking Scientific Articles by Exploiting Citations, Authors, Journals, and Time Information, AAAI'13 : Proceedings of the 27th Conference on Artificial Intelligence, pp.933-939, 2013.

L. Wildgaard, A comparison of 17 author-level bibliometric indicators for researchers in Astronomy, Environmental Science, Philosophy and Public Health in Web of Science and Google Scholar, Scientometrics, vol.104, issue.3, p.32, 2015.

D. Yimam and A. Kobsa, DEMOIR : A Hybrid Architecture for Expertise Modeling and Recommender Systems, WETICE : Proceedings of the 9th IEEE International Workshops on Enabling Technologies : Infrastructure for Collaborative Enterprises, p.14, 2000.

J. Zhang, ]. Jing, J. Tang, and J. Li, Expert Finding in a Social Network, DASFAA'07 : Proceedings of the 12th International Conference on Database Systems for Advanced Applications, p.20, 2007.

J. Zhang, M. S. Ackerman, and L. A. Adamic, Expertise networks in online communities : structure and algorithms, WWW'07 : Proceedings of the 16th International Conference on World Wide Web, p.20, 2007.

J. Zhu, X. Huang, D. Song, and S. M. Rüger, Integrating multiple document features in language models for expert finding, Knowledge and Information Systems, vol.23, issue.1, p.18, 2010.

Z. Zhuang, E. Elmacioglu, D. Lee, and C. L. Giles, Measuring conference quality by mining program committee characteristics, JCDL'07 : Proceedings of the 2007 conference on Digital libraries, p.34, 2007.

H. Zuckerman and R. K. Merton, Patterns of Evaluation in Science : Institutionalisation, Structure and Functions of the Referee System. Minerva, vol.9, issue.1, p.91, 1971.