I. Boutron, S. Dutton, P. Ravaud, and D. Altman, Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes, JAMA, 2010.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

J. T. Hancock, D. I. Beaver, C. K. Chung, J. Frazee, J. W. Pennebaker et al., Social language processing: A framework for analyzing the communication of terrorists and authoritarian regimes, Behavioral Sciences of Terrorism and Political Aggression, vol.2, issue.2, pp.108-132, 2010.

R. Haneef, C. Lazarus, P. Ravaud, A. Yavchitz, and I. Boutron, Interpretation of results of studies evaluating an intervention highlighted in google health news: a cross-sectional study of news, PLoS ONE, 2015.

A. Koroleva and P. Paroubek, On the contribution of specific entity detection and comparative construction to automatic spin detection in biomedical scientific publications, Proceedings of The Second Workshop on Processing Emotions, Decisions and Opinions at The 8th Language and Technology Conference, 2017.

A. Koroleva and P. Paroubek, Automatic detection of inadequate claims in biomedical articles: first steps, Proceedings of Workshop on Curative Power of MEdical Data, 2017.

C. Lazarus, R. Haneef, P. Ravaud, and I. Boutron, Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention, BMC Med Res Methodol, p.39, 2015.

O. Litvinova, P. Seredin, T. Litvinova, and J. Lyell, Deception detection in Russian texts, Proceedings of the Student Research Workshop at the 15th Conference of the European Chapter of the Association for Computational Linguistics, pp.43-52, 2017.

R. Mihalcea and C. Strapparava, The lie detector: Explorations in the automatic recognition of deceptive language, Proceedings of the ACL-IJCNLP 2009 Conference Short Papers, pp.309-312, 2009.

N. Nakashole and T. M. Mitchell, Language-aware truth assessment of fact candidates, Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol.1, pp.1009-1019, 2014.

A. Pak, Automatic, adaptive, and applicative sentiment analysis, 2012.
URL : https://hal.archives-ouvertes.fr/tel-00717329

J. Pustejovsky, J. Castano, R. Ingria, R. Saurí, R. Gaizauskas et al., Timeml: Robust specification of event and temporal expressions in text, Fifth International Workshop on Computational Semantics, 2003.

X. Tannier, WebAnnotator, an annotation tool for web pages, Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC-2012), pp.316-319, 2012.
URL : https://hal.archives-ouvertes.fr/hal-02493909

A. Widlöcher and Y. Mathet, The glozz platform: A corpus annotation and mining tool, Proceedings of the 2012 ACM Symposium on Document Engineering, DocEng '12, pp.171-180, 2012.

J. Wiebe and E. Riloff, Creating subjective and objective sentence classifiers from unannotated texts, Proceedings of the 6th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing'05, pp.486-497, 2005.

A. Yavchitz, I. Boutron, A. Bafeta, I. Marroun, P. Charles et al., Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study, PLoS Med, 2012.

A. Yavchitz, P. Ravaud, D. G. Altman, D. Moher, A. Hróbjartsson et al., A new classification of spin in systematic reviews and meta-analyses was developed and ranked according to the severity, Journal of clinical epidemiology, vol.75, pp.56-65, 2016.

I. References, A. Beltagy, K. Cohan, and . Lo, Scibert: Pretrained contextualized embeddings for scientific text, 2019.

C. Blake and R. Kehm, Comparing breast cancer treatments using automatically detected surrogate and clinically relevant outcomes entities from text, Journal of Biomedical Informatics: X, vol.1, p.100005, 2019.

C. Blake and A. Lucic, Automatic endpoint detection to support the systematic review process, J. Biomed. Inform, 2015.

F. Boudin, J. Nie, J. Bartlett, R. Grad, P. Pluye et al., Combining classifiers for robust pico element detection, BMC medical informatics and decision making, vol.10, p.29, 2010.

I. Boutron, S. Dutton, P. Ravaud, and D. Altman, Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes, JAMA, 2010.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

B. D. Bruijn, S. Carini, S. Kiritchenko, J. Martin, and I. Sim, Automated information extraction of key trial design elements from clinical trial publications, Proceedings of the AMIA Annual Symposium, 2008.

D. Demner-fushman and J. Lin, Knowledge extraction for clinical question answering : Preliminary results, Proc of the AAAI 2005 Workshop on Question Answering in Restricted Domains, 2005.

D. Demner-fushman and J. Lin, Answering clinical questions with knowledge-based and statistical techniques, Computational Linguistics, vol.33, issue.1, pp.63-103, 2007.

D. Demner-fushman, B. Few, S. Hauser, and G. Thoma, Automatically identifying health outcome information in medline records, Journal of the American Medical Informatics Association, 2006.

J. Devlin, M. Chang, K. Lee, and K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, 2018.

Y. Cao, J. J. Cimino, J. Ely, and H. Yu, Automatically extracting information needs from complex clinical questions, Journal of Biomedical Informatics, vol.43, issue.6, pp.962-971, 2010.

B. Goldacre, H. Drysdale, A. Powell-smith, A. Dale, I. Milosevic et al.,

R. Haneef, C. Lazarus, P. Ravaud, A. Yavchitz, and I. Boutron, Interpretation of results of studies evaluating an intervention highlighted in google health news: a cross-sectional study of news, PLoS ONE, 2015.

H. Hassanzadeh, T. Groza, and J. Hunter, Identifying scientific artefacts in biomedical literature: The evidence based medicine use case, Journal of Biomedical Informatics, vol.49, pp.159-170, 2014.

J. P. Higgins, D. G. Altman, P. C. Gøtzsche, P. Jüni, D. Moher et al., The Cochrane Collaboration's tool for assessing risk of bias in randomised trials, BMJ, vol.343, 2011.

M. Honnibal and M. Johnson, An improved non-monotonic transition system for dependency parsing, Proc. of EMNLP 2015, pp.1373-1378, 2015.

K. Huang, I. Chiang, F. Xiao, C. Liao, C. C. et al., Pico element detection in medical text without metadata: Are first sentences enough, Journal of Biomedical Informatics, vol.46, issue.5, pp.940-946, 2013.

M. Huang, A. Névéol, and Z. Lu, Recommending mesh terms for annotating biomedical articles, Journal of the American Medical Informatics Association : JAMIA, vol.18, pp.660-667, 2011.

D. Jin and P. Szolovits, PICO element detection in medical text via long short-term memory neural networks, Proceedings of the BioNLP 2018 workshop, pp.67-75, 2018.

S. R. Jonnalagadda, P. Goyal, and M. D. Huffman, Automating data extraction in systematic reviews: a systematic review, Systematic reviews, 2015.

R. Khare, R. Leaman, and Z. Lu, Accessing biomedical literature in the current information landscape, Methods in molecular biology, vol.1159, pp.11-31, 2014.

S. Kim, D. Martinez, L. Cavedon, and L. Yencken, Automatic classification of sentences to support evidence based medicine, BMC bioinformatics, vol.12, issue.2, p.5, 2011.

S. Kiritchenko, B. D. Bruijn, S. Carini, J. Martin, and I. Sim, Exact: automatic extraction of clinical trial characteristics from journal publications, BMC Med Inform Decis Mak, 2010.

A. Koroleva, Annotated corpus for primary and reported outcomes extraction, 2019.

A. Koroleva and P. Paroubek, Demonstrating construkt, a text annotation toolkit for generalized linguistic contructions applied to communication spin, The 9th Language and Technology Conference, 2019.

J. Lee, W. Yoon, S. Kim, D. Kim, S. Kim et al., Biobert: a pretrained biomedical language representation model for biomedical text mining, 2019.

A. Lucic and C. Blake, Improving endpoint detection to support automated systematic reviews, AMIA Annu Symp Proc, 2016.

X. Ma and E. Hovy, End-to-end sequence labeling via bi-directional lstm-cnns-crf, Proceedings of the 54th Annual Meeting of the ACL, vol.1, pp.1064-1074, 2016.

B. Nye, J. J. Li, R. Patel, Y. Yang, I. Marshall et al., A corpus with multi-level annotations of patients, interventions and outcomes to support language processing for medical literature, Proceedings of the 56th Annual Meeting of the Association for, vol.66

, Long Papers), vol.1, pp.197-207, 2018.

J. Pennington, R. Socher, and C. Manning, Glove: Global vectors for word representation, Proc. of EMNLP 2014, pp.1532-1543, 2014.

M. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark et al., Deep contextualized word representations, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol.1, 2018.

A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever, Improving language understanding with unsupervised learning, 2018.

D. Rennie, Consort revised -improving the reporting of randomized trials, JAMA, vol.285, 2001.

W. Richardson, M. Wilson, J. Nishikawa, and R. Hayward, The well-built clinical question: a key to evidence-based decisions, ACP J Club, vol.123, issue.3, 1995.

K. F. Schulz, D. G. Altman, and D. Moher, Consort 2010 statement: updated guidelines for reporting parallel group randomised trials, BMJ, vol.340, 2010.

R. Summerscales, S. Argamon, J. Hupert, and A. Schwartz, Identifying treatments, groups, and outcomes in medical abstracts, Proceedings of the Sixth Midwest Computational Linguistics Colloquium (MCLC), 2009.

R. L. Summerscales, S. E. Argamon, S. Bai, J. Hupert, and A. Schwartz, Automatic summarization of results from clinical trials, IEEE International Conference on Bioinformatics and Biomedicine, pp.372-377, 2011.

M. Verbeke, V. Van-asch, R. Morante, P. Frasconi, W. Daelemans et al., A statistical relational learning approach to identifying evidence based medicine categories, Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learnin, pp.579-589, 2012.

D. References, D. Altman, K. Moher, and . Schulz, Harms of outcome switching in reports of randomised trials: Consort perspective, BMJ: British Medical Journal, 2017.

N. Altman, An introduction to kernel and nearest-neighbor nonparametric regression, American Statistician -AMER STATIST, vol.46, pp.175-185, 1992.

M. B. Aouicha and M. A. Taieb, Computing semantic similarity between biomedical concepts using new information content approach, Journal of Biomedical Informatics, vol.59, pp.258-275, 2016.

A. Aronson, Effective mapping of biomedical text to the umls metathesaurus: The metamap program, AMIA Annual Symposium, pp.17-21, 2001.

I. Beltagy, A. Cohan, and K. Lo, Scibert: Pretrained contextualized embeddings for scientific text, 2019.

W. Blacoe and M. Lapata, A comparison of vector-based representations for semantic composition, Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, vol.94, pp.546-556

J. Island and . Korea, Association for Computational Linguistics, 2012.

K. Blagec, H. Xu, A. Agibetov, and M. Samwald, Neural sentence embedding models for semantic similarity estimation in the biomedical domain, BMC Bioinformatics, p.178, 2019.

I. Boutron and P. Ravaud, Misrepresentation and distortion of research in biomedical literature, Proc Natl Acad Sci U S A, 2018.

I. Boutron, S. Dutton, P. Ravaud, and D. Altman, Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes, JAMA, 2010.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

L. Breiman, Random forests, Mach. Learn, vol.45, issue.1, pp.5-32, 2001.

J. E. Caviedes and J. J. Cimino, Towards the development of a conceptual distance metric for the umls, Journal of Biomedical Informatics, vol.37, issue.2, pp.77-85, 2004.

K. Chiu, Q. Grundy, and L. Bero, Spin' in published biomedical literature: A methodological systematic review, PLoS Biol, 2017.

C. Cortes and V. Vapnik, Support-vector networks, Machine Learning, vol.20, pp.273-297, 1995.

J. Devlin, M. Chang, K. Lee, and K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, 2018.

J. Diong, A. Butler, S. Gandevia, and M. Héroux, Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice, PLoS One, 2018.

C. Fellbaum, WordNet: An electronic lexical database (Language, Speech, and Communication), 1998.

Y. Freund and R. E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences, vol.55, issue.1, pp.119-139, 1997.

J. H. Friedman, Stochastic gradient boosting, Comput. Stat. Data Anal, vol.38, issue.4, pp.65-67, 2002.

P. Geurts, D. Ernst, and L. Wehenkel, Extremely randomized trees, Mach. Learn, vol.63, issue.1, pp.3-42, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00341932

M. Ghert, The reporting of outcomes in randomised controlled trials: The switch and the spin, Bone and Joint Research, vol.6, p.2017

B. Goldacre, H. Drysdale, A. Powell-smith, A. Dale, I. Milosevic et al.,

B. Goldacre, H. Drysdale, A. Dale, I. Milosevic, E. Slade et al., Compare: a prospective cohort study correcting and monitoring 58 misreported trials in real time, Trials, vol.20, issue.1, p.118, 2019.

R. Haneef, C. Lazarus, P. Ravaud, A. Yavchitz, and I. Boutron, Interpretation of results of studies evaluating an intervention highlighted in google health news: a cross-sectional study of news, PLoS ONE, 2015.

S. Harispe, D. Sánchez, S. Ranwez, S. Janaqi, and J. Montmain, A framework for unifying ontology-based semantic similarity measures: A study in the biomedical domain, Journal of Biomedical Informatics, vol.48, pp.38-53, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01059534

S. Henry, C. Cuffy, and B. T. Mcinnes, Vector representations of multi-word terms for semantic relatedness, Journal of Biomedical Informatics, vol.77, pp.111-119, 2018.

S. Henry, A. Mcquilkin, and B. T. Mcinnes, Association measures for estimating semantic similarity and relatedness between biomedical concepts, Artificial Intelligence in, vol.96

, Medicine, vol.93, pp.1-10, 2019.

M. Honnibal and M. Johnson, An improved non-monotonic transition system for dependency parsing, Proc. of EMNLP 2015, pp.1373-1378, 2015.

. Acl and . Url,

A. Koroleva, Annotated corpus for the relation between reported outcomes and their significance levels, 2019.

C. Lazarus, R. Haneef, P. Ravaud, and I. Boutron, Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention, BMC Med Res Methodol, 2015.

C. Leacock and M. Chodorow, Combining Local Context and WordNet Similarity for Word Sense Identification, MITP, vol.49, p.265, 1998.

J. Lee, W. Yoon, S. Kim, D. Kim, S. Kim et al., Biobert: a pretrained biomedical language representation model for biomedical text mining, 2019.

D. Lin, An information-theoretic definition of similarity, Proceedings of the Fifteenth International Conference on Machine Learning, ICML '98, pp.296-304, 1998.

S. Lockyer, R. Hodgson, J. Dumville, and N. Cullum, Spin" in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes, Trials, 2013.

P. Lord, R. Stevens, A. Brass, and C. Goble, Investigating semantic similarity measures across the gene ontology: The relationship between sequence and annotation, Bioinformatics, vol.19, pp.1275-1283, 2003.

B. T. Mcinnes, T. Pedersen, and S. V. Pakhomov, Umls-interface and umls-similarity : Open source software for measuring paths and semantic similarity, AMIA ... Annual Symposium proceedings. AMIA Symposium, pp.431-436, 2009.

A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever, Improving language understanding with unsupervised learning, 2018.

C. E. Rasmussen and C. K. Williams, Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning), vol.026218253, 2005.

J. Ratcliff and D. Metzener, Pattern matching: The gestalt approach, Dr. Dobb's Journal, 1998.

R. Rehurek and P. Sojka, Software framework for topic modelling with large corpora, Proc. LREC Workshop on New Challenges for NLP Frameworks, pp.2216-2219, 2010.

P. Resnik, Using information content to evaluate semantic similarity in a taxonomy, Proceedings of the 14th International Joint Conference on Artificial Intelligence, vol.1, pp.448-453, 1995.

L. Rokach and O. Maimon, Data Mining with Decision Trees: Theroy and Applications, p.9812771719, 2008.

D. Sánchez and M. Batet, Semantic similarity estimation in the biomedical domain: An ontology-based information-theoretic perspective, Journal of Biomedical Informatics, vol.44, issue.5, pp.749-759, 2011.

E. Slade, H. Drysdale, and B. Goldacre, Discrepancies between prespecified and reported outcomes, BMJ, 2015.

P. Smith, R. Morrow, and D. Ross, Outcome measures and case definition, Field Trials of Health Interventions: A Toolbox, 2015.

G. Sogancioglu, H. Öztürk, and A. Özgür, Biosses: a semantic sentence similarity estimation system for the biomedical domain, Bioinformatics, pp.33-47, 2017.

I. Spasi? and S. Ananiadou, A flexible measure of contextual similarity for biomedical terms, Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing, pp.197-208

D. Altman, K. Moher, and . Schulz, Harms of outcome switching in reports of randomised trials: Consort perspective, BMJ: British Medical Journal, 2017.

I. Amini, D. Martinez, and D. Molla, Overview of the alta 2012 shared task, Australasian L. T. Association Workshop, p.124, 2012.

A. Aronson, Effective mapping of biomedical text to the umls metathesaurus: The metamap program, AMIA Annual Symposium, pp.17-21, 2001.

I. Beltagy, A. Cohan, and K. Lo, Scibert: Pretrained contextualized embeddings for scientific text, 2019.

C. Blake and A. Lucic, Automatic endpoint detection to support the systematic review process, J. Biomed. Inform, 2015.

I. Boutron and P. Ravaud, Misrepresentation and distortion of research in biomedical literature, Proc Natl Acad Sci U S A, 2018.

I. Boutron, S. Dutton, P. Ravaud, and D. Altman, Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes, JAMA, 2010.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

B. D. Bruijn, S. Carini, S. Kiritchenko, J. Martin, and I. Sim, Automated information extraction of key trial design elements from clinical trial publications, Proceedings of the AMIA Annual Symposium, 2008.

A. Chan, J. Tetzlaff, D. Altman, A. Laupacis, P. Gøtzsche et al., Spirit 2013 statement: Defining standard protocol items for clinical trials, Ann Intern Med, 2013.

K. Chiu, Q. Grundy, and L. Bero, Spin' in published biomedical literature: A methodological systematic review, PLoS Biol, 2017.

A. F. Delgado and A. F. Delgado, Outcome switching in randomized controlled oncology trials reporting on surrogate endpoints: a cross-sectional analysis, Scientific Reports, vol.116, 2017.

D. Demner-fushman, B. Few, S. Hauser, and G. Thoma, Automatically identifying health outcome information in medline records, Journal of the American Medical Informatics Association, 2006.

J. Devlin, M. Chang, K. Lee, and K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, 2018.

J. Diong, A. Butler, S. Gandevia, and M. Héroux, Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice, PLoS One, 2018.

B. Goldacre, H. Drysdale, A. Powell-smith, A. Dale, I. Milosevic et al.,

B. Goldacre, H. Drysdale, A. T. Dale, I. Milosevic, E. S. Slade et al., Compare: a prospective cohort study correcting and monitoring 58 misreported trials in real time, Trials, 2019.

R. Haneef, C. Lazarus, P. Ravaud, A. Yavchitz, and I. Boutron, Interpretation of results of studies evaluating an intervention highlighted in google health news: a cross-sectional study of news, PLoS ONE, 2015.

S. Henry, C. Cuffy, and B. T. Mcinnes, Vector representations of multi-word terms for semantic relatedness, Journal of Biomedical Informatics, vol.77, pp.111-119, 2018.

C. W. Jones, B. S. Misemer, T. F. Platts-mills, R. Ahn, A. Woodbridge et al., Primary outcome switching among drug trials with and without principal investigator financial ties to industry: a cross-sectional study, BMJ Open, vol.8, issue.2, 2018.

A. Kay, J. D. Higgins, A. G. Day, R. M. Meyer, and C. Booth, Randomized controlled trials in the era of molecular oncology: methodology, biomarkers, and end points, Annals of oncology : official journal of the European Society for Medical Oncology, vol.23, pp.1646-51, 2012.

T. Kenter and M. De-rijke, Short text similarity with word embeddings, CIKM, 2015.

S. Kim, D. Martinez, L. Cavedon, and L. Yencken, Automatic classification of sentences to support evidence based medicine, BMC bioinformatics, vol.12, issue.2, p.5, 2011.

S. Kiritchenko, B. D. Bruijn, S. Carini, J. Martin, and I. Sim, Exact: automatic extraction of clinical trial characteristics from journal publications, BMC Med Inform Decis Mak, 2010.

A. Koroleva, Annotated corpus for primary and reported outcomes extraction, 2019.

A. Koroleva, Annotated corpus for semantic similarity of clinical trial outcomes, 2019.

C. Lazarus, R. Haneef, P. Ravaud, and I. Boutron, Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention, BMC Med Res Methodol, 2015.

J. Lee, W. Yoon, S. Kim, D. Kim, S. Kim et al., Biobert: a pretrained biomedical language representation model for biomedical text mining, 2019.

S. Lockyer, R. Hodgson, J. Dumville, and N. Cullum, Spin" in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes, Trials, 2013.

A. Lucic and C. Blake, Improving endpoint detection to support automated systematic reviews, AMIA Annu Symp Proc, 2016.

M. Lui, Feature stacking for sentence classification in evidence-based medicine, Proc. of Australasian L. T. Association Workshop, 2012.

J. Martinez-gil, An overview of textual semantic similarity measures based on web intelligence, Artificial Intelligence Review, vol.42, p.2012
URL : https://hal.archives-ouvertes.fr/hal-01630890

T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean, Distributed representations of words and phrases and their compositionality, Proceedings of the 26th International Conference on Neural Information Processing Systems, vol.2, pp.3111-3119, 2013.

N. Miura and T. Takagi, WSL: Sentence similarity using semantic distance between words, Proceedings of the 9th International Workshop on Semantic Evaluation, 2015.

, , pp.128-131, 2015.

D. Mollá, Experiments with clustering-based features for sentence classification in medical publications: Macquarie test's participation in the ALTA 2012 shared task, Proc. of

L. T. Australasian, Association Workshop, pp.139-142, 2012.

J. Park, K. Kim, W. Hwang, and D. Lee, Concept embedding to measure semantic relatedness for biomedical information ontologies, Journal of Biomedical Informatics, vol.94, p.103182, 2019.

M. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark et al., Deep contextualized word representations, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol.1, 2018.

A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever, Improving language understanding with unsupervised learning, 2018.

K. F. Schulz, D. G. Altman, and D. Moher, Consort 2010 statement: updated guidelines for reporting parallel group randomised trials, BMJ, vol.340, 2010.

E. Slade, H. Drysdale, and B. Goldacre, Discrepancies between prespecified and reported outcomes, BMJ, 2015.

G. Sogancioglu, H. Öztürk, and A. Özgür, Biosses: a semantic sentence similarity estimation system for the biomedical domain, Bioinformatics, pp.33-47, 2017.

R. Summerscales, S. Argamon, J. Hupert, and A. Schwartz, Identifying treatments, groups, and outcomes in medical abstracts, Proceedings of the Sixth Midwest Computational Linguistics Colloquium (MCLC), 2009.

F. Asr, R. Zinkov, and M. Jones, Querying word embeddings for similarity and relatedness, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol.1, p.119

, Association for Computational Linguistics, pp.675-684, 2018.

J. Weston, K. Dwan, D. Altman, M. Clarke, C. Gamble et al., Feasibility study to examine discrepancy rates in prespecified and reported outcomes in articles submitted to the bmj, BMJ Open, 2016.

A. Yavchitz, I. Boutron, A. Bafeta, I. Marroun, P. Charles et al., Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study, PLoS Med, 2012.

M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis et al., Tensorflow: A system for largescale machine learning, 2016.

N. Altman, An introduction to kernel and nearest-neighbor nonparametric regression, American Statistician -AMER STATIST, vol.46, pp.175-185, 1992.

M. Asada, M. Miwa, and Y. Sasaki, Extracting drug-drug interactions with attention CNNs, pp.9-18, 2017.

I. Beltagy, A. Cohan, and K. Lo, Scibert: Pretrained contextualized embeddings for scientific text, 2019.

J. Björne and T. Salakoski, Biomedical event extraction using convolutional neural networks and dependency parsing, BioNLP 2018 workshop, pp.98-108, 2018.

C. Blake and A. Lucic, Automatic endpoint detection to support the systematic review process, J. Biomed. Inform, 2015.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

L. Breiman, Random forests, Mach. Learn, vol.45, issue.1, pp.5-32, 2001.

D. Chavalarias, J. D. Wallach, A. H. Li, and J. P. Ioannidis, Evolution of reporting p values in the biomedical literature, JAMA, vol.315, pp.1141-1149, 1990.

F. Chollet, , 2015.

C. Cortes and V. Vapnik, Support-vector networks, Machine Learning, vol.20, pp.273-297, 1995.

D. Demner-fushman, B. Few, S. Hauser, and G. Thoma, Automatically identifying health outcome information in medline records, Journal of the American Medical Informatics Association, 2006.

J. Devlin, M. Chang, K. Lee, and K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, 2018.

Y. Freund and R. E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences, vol.55, issue.1, pp.119-139, 1997.

J. H. Friedman, Stochastic gradient boosting, Comput. Stat. Data Anal, vol.38, issue.4, pp.65-67, 2002.

P. Geurts, D. Ernst, and L. Wehenkel, Extremely randomized trees, Mach. Learn, vol.63, issue.1, pp.3-42, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00341932

R. Haneef, C. Lazarus, P. Ravaud, A. Yavchitz, and I. Boutron, Interpretation of results of studies evaluating an intervention highlighted in google health news: a cross-sectional study of news, PLoS ONE, 2015.

M. L. Head, L. Holman, R. Lanfear, A. T. Kahn, and M. D. Jennions, The extent and consequences of p-hacking in science, PLoS biology, 2015.

M. Honnibal and M. Johnson, An improved non-monotonic transition system for dependency parsing, Proc. of EMNLP 2015, pp.1373-1378, 2015.

W. Hsu, W. Speier, and R. K. Taira, Automated extraction of reported statistical analyses: Towards a logical representation of clinical trial literature, AMIA Annual Symposium, pp.350-359, 2012.

A. Koroleva, Annotated corpus for the relation between reported outcomes and their significance levels, 2019.

J. Lee, W. Yoon, S. Kim, D. Kim, S. Kim et al., Biobert: a pretrained biomedical language representation model for biomedical text mining, 2019.

J. Lever and S. Jones, Painless relation extraction with kindred, pp.176-183, 2017.

A. Lucic and C. Blake, Improving endpoint detection to support automated systematic reviews, AMIA Annu Symp Proc, 2016.

X. Ma and E. Hovy, End-to-end sequence labeling via bi-directional lstm-cnns-crf, Proceedings of the 54th Annual Meeting of the ACL, vol.1, pp.1064-1074, 2016.

M. Miwa and M. Bansal, End-to-end relation extraction using LSTMs on sequences and tree structures, Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol.1, pp.1105-1116, 2016.

S. Pawar, P. Bhattacharyya, and G. Palshikar, End-to-end relation extraction using neural networks and Markov logic networks, Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, vol.1, pp.818-827, 2017.

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion et al., Scikit-learn: Machine learning in Python, Journal of Machine Learning Research, vol.12, pp.2825-2830, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00650905

Y. Peng and Z. Lu, Deep learning for extracting protein-protein interactions from biomedical literature, pp.29-38, 2017.

Y. Peng, M. Torii, C. Wu, and K. Vijay-shanker, A generalizable nlp framework for fast development of pattern-based biomedical relation extraction systems, BMC bioinformatics, vol.15, p.285, 2014.

J. Pennington, R. Socher, and C. Manning, Glove: Global vectors for word representation, Proc. of EMNLP 2014, pp.1532-1543, 2014.

C. E. Rasmussen and C. K. Williams, Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning), vol.026218253, 2005.

L. Rokach and O. Maimon, Data Mining with Decision Trees: Theroy and Applications, p.9812771719, 2008.

T. M. Schindler, Hypothesis testing in clinical trials, AMWA Journal, vol.30, issue.2, 2015.

C. Der-malsburg, Frank rosenblatt: Principles of neurodynamics: Perceptrons and the theory of brain mechanisms, Brain Theory, vol.01, pp.245-248, 1986.

A. Yavchitz, I. Boutron, A. Bafeta, I. Marroun, P. Charles et al., Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study, PLoS Med, 2012.

D. Zhou, D. Zhong, and Y. He, Biomedical relation extraction: From binary to complex, Comp. Math. Methods in Medicine, 2014.

S. References, B. Ananiadou, N. Rea, R. Okazaki, J. Procter et al., Supporting systematic reviews using text mining, Social Science Computer Review -SOC SCI COMPUT REV, vol.27, pp.509-523, 2009.

J. Austin, C. Smith, K. Natarajan, M. Som, C. Wayant et al., Evaluation of spin within abstracts in obesity randomized clinical trials: A cross-sectional review: Spin in obesity clinical trials, Clinical Obesity, vol.9, p.12292, 2018.

C. Barnes, I. Boutron, B. Giraudeau, R. Porcher, D. Altman et al., Impact of an online writing aid tool for writing a randomized trial report: The cobweb (consort-based web tool) randomized controlled trial, BMC medicine, vol.13, p.221, 2015.

L. Beijers, B. F. Jeronimus, E. H. Turner, P. De-jonge, and A. M. Roest, Spin in rcts of anxiety medication with a positive primary outcome: a comparison of concerns expressed by the us fda and in the published literature, BMJ Open, vol.7, issue.3, 2017.

I. Beltagy, A. Cohan, and K. Lo, Scibert: Pretrained contextualized embeddings for scientific text, 2019.

I. Boutron, S. Dutton, P. Ravaud, and D. Altman, Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes, JAMA, 2010.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

C. M. Cooper, H. M. Gray, A. E. Ross, T. A. Hamilton, J. B. Downs et al., Evaluation of spin in the abstracts of otolaryngology randomized controlled trials: Spin found in majority of clinical trials, The Laryngoscope, vol.12, p.2018

F. Dernoncourt and J. Y. Lee, PubMed 200k RCT: a dataset for sequential sentence classification in medical abstracts, Short Papers), vol.2, pp.308-313, 2017.

J. Devlin, M. Chang, K. Lee, and K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, 2018.

P. S. Fleming, Evidence of spin in clinical trials in the surgical literature, Ann Transl Med, vol.4, issue.385, 2016.

B. Goldacre, H. Drysdale, A. Dale, I. Milosevic, E. Slade et al., Compare: a prospective cohort study correcting and monitoring 58 misreported trials in real time, Trials, vol.20, issue.1, p.118, 2019.

, Cochrane handbook for systematic reviews of interventions, 2008.

M. Huang, A. Névéol, and Z. Lu, Recommending mesh terms for annotating biomedical articles, Journal of the American Medical Informatics Association : JAMIA, vol.18, pp.660-667, 2011.

J. Ioannidis, Why most published research findings are false, PLoS medicine, vol.2, p.124, 2005.

M. Khan, N. Lateef, T. Siddiqi, K. Abdur-rehman, S. Alnaimat et al., Level and prevalence of spin in published cardiovascular randomized clinical trial reports with statistically nonsignificant primary outcomes: A systematic review, JAMA Network Open, vol.2, p.192622, 2019.

N. Kinder, M. Weaver, C. Wayant, and M. Vassar, Presence of 'spin' in the abstracts and titles of anaesthesiology randomised controlled trials, British Journal of Anaesthesia, vol.122, 2018.

S. Kiritchenko, B. D. Bruijn, S. Carini, J. Martin, and I. Sim, Exact: automatic extraction of clinical trial characteristics from journal publications, BMC Med Inform Decis Mak, 2010.

C. Lazarus, R. Haneef, P. Ravaud, and I. Boutron, Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention, BMC Med Res Methodol, 2015.

J. Lee, W. Yoon, S. Kim, D. Kim, S. Kim et al., Biobert: a pretrained biomedical language representation model for biomedical text mining, 2019.

S. Lockyer, R. W. Hodgson, J. C. Dumville, and N. Cullum, Spin" in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes, Trials, 2013.

I. Marshall, J. Kuiper, E. Banner, and B. C. Wallace, Automating biomedical evidence synthesis: RobotReviewer, Proceedings of ACL 2017, System Demonstrations, pp.7-12, 2017.

I. J. Marshall, J. Kuiper, and B. C. Wallace, Robotreviewer: Evaluation of a system for automatically assessing bias in clinical trials, Journal of the American Medical Informatics Association : JAMIA, vol.23, 2015.

J. Mork, A. Jimeno-yepes, and A. Aronson, The nlm medical text indexer system for indexing biomedical literature, CEUR Workshop Proceedings, p.1094, 2013.

J. Mork, A. Aronson, and D. Demner-fushman, 12 years on -is the NLM medical text indexer still useful and relevant, Journal of Biomedical Semantics, vol.8, issue.1, 2017.

Z. Samaan, L. Mbuagbaw, D. Kosa, V. Borg-debono, R. Dillenburg et al., A systematic scoping review of adherence to reporting guidelines in health care literature, Journal of multidisciplinary healthcare, vol.6, pp.169-88, 2013.

K. F. Schulz, D. G. Altman, and D. Moher, Consort 2010 statement: updated guidelines for reporting parallel group randomised trials, BMJ, vol.340, 2010.

F. Soboczenski, T. Trikalinos, J. Kuiper, R. G. Bias, B. Wallace et al., Machine learning to help researchers evaluate biases in clinical trials: A prospective, randomized user study, BMC Medical Informatics and Decision Making, vol.19, p.2019

F. E. Vera-badillo, M. Napoleone, M. K. Krzyzanowska, S. M. Alibhai, A. Chan et al., Bias in reporting of randomised clinical trials in oncology, European Journal of Cancer, vol.61, pp.29-35, 2016.

A. Yavchitz, I. Boutron, A. Bafeta, I. Marroun, P. Charles et al., Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study, PLoS Med, 2012.

, Note that even for qualitative outcomes "disease burden") measurement tool may not be defined

, outcome measure + measurement tool used: "depression measured by the BDI-II, the QALY based on the EQ-5D

, claim duration (in days) during 12 months follow-up" 4. outcome measure + analysis metric

, outcome measure + analysis metric + time points: "change in HOMA index, from week 0 (pre-treatment) to week 6

, outcome measure + aggregation metric: "the proportion of women reporting a live birth defined as the delivery of one or more living infants, >20 weeks gestation or 400 g or more birth weight

, outcome measure + analysis metric + aggregation metric: "mean IMT-CCA change" 8. outcome measure + analysis metric + time points + aggregation metric, The mean decrease in HAM-D score from baseline

, for the per protocol (PP) population using a "worse eye" analysis". An outcome description may state that the outcome is a surrogate measure: "a surrogate marker, Ang-2", -and may also refer to the substituted measure: "the active local radiation dose leading to metastasis infiltrating T cells as a surrogate parameter for antitumor activity". Apart from aspects describing what was measured and how, an outcome may explicitly state the comparison between groups that was performed, IOP from baseline to week 4 at 8 a.m. and 4 p.m

D. References, D. Altman, K. Moher, and . Schulz, Harms of outcome switching in reports of randomised trials: Consort perspective, BMJ: British Medical Journal, 2017.

S. Ananiadou, B. Rea, N. Okazaki, R. Procter, and J. Thomas, Supporting systematic reviews using text mining, Social Science Computer Review -SOC SCI COMPUT REV, vol.27, pp.509-523, 2009.

C. Andrade, The primary outcome measure and its importance in clinical trials, The Journal of clinical psychiatry, vol.76, p.2015

C. Begg, M. Cho, S. Eastwood, R. Horton, D. Moher et al.,

D. Schulz, D. F. Simel, and . Stroup, Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement, JAMA, vol.276, issue.8, pp.637-639, 1996.

C. Blake and A. Lucic, Automatic endpoint detection to support the systematic review process, J. Biomed. Inform, 2015.

I. Boutron and P. Ravaud, Misrepresentation and distortion of research in biomedical literature, Proc Natl Acad Sci U S A, 2018.

I. Boutron, S. Dutton, P. Ravaud, and D. Altman, Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes, JAMA, 2010.

I. Boutron, D. Altman, S. Hopewell, F. Vera-badillo, I. Tannock et al., Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial, Journal of Clinical Oncology, 2014.

A. Chan, J. Tetzlaff, D. Altman, K. Dickersin, and D. Moher, Spirit: New guidance for content of clinical trial protocols, Lancet, p.381, 2013.

K. Chiu, Q. Grundy, and L. Bero, Spin' in published biomedical literature: A methodological systematic review, PLoS Biol, 2017.

L. Curtis, A. Hernandez, and K. Weinfurt, Choosing and specifying endpoints and outcomes: Introduction. In Rethinking Clinical Trials: A Living Textbook of Pragmatic Clinical Trials. NIH Health Care Systems Research Collaboratory, 2019.

D. Demner-fushman, B. Few, S. Hauser, and G. Thoma, Automatically identifying health outcome information in medline records, Journal of the American Medical Informatics Association, 2006.

J. Diong, A. Butler, S. Gandevia, and M. Héroux, Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice, PLoS One, 2018.

J. Ferreira and C. M. Patino, Types of outcomes in clinical research, Jornal Brasileiro de Pneumologia, vol.43, p.2017

E. F. Gehringer, F. Pramudianto, A. Medhekar, C. Rajasekar, and Z. Xiao, Applications of artificial intelligence in peer assessment, 2018 ASEE Annual Conference & Exposition, vol.62, 2018.

B. Goldacre, H. Drysdale, A. Powell-smith, A. Dale, I. Milosevic et al.,

B. Goldacre, H. Drysdale, A. Dale, I. Milosevic, E. Slade et al., Compare: a prospective cohort study correcting and monitoring 58 misreported trials in real time, Trials, vol.20, issue.1, p.118, 2019.

R. Haneef, C. Lazarus, P. Ravaud, A. Yavchitz, and I. Boutron, Interpretation of results of studies evaluating an intervention highlighted in google health news: a cross-sectional study of news, PLoS ONE, 2015.

D. Kang, W. Ammar, B. Dalvi, M. Van-zuylen, S. Kohlmeier et al., A dataset of peer reviews (peerread): Collection, insights and nlp applications, vol.04, 2018.

C. Lazarus, R. Haneef, P. Ravaud, and I. Boutron, Classification and prevalence of spin in abstracts of non-randomized studies evaluating an intervention, BMC Med Res Methodol, 2015.

S. Lockyer, R. Hodgson, J. Dumville, and N. Cullum, Spin" in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes, Trials, 2013.

A. O'mara-eves, J. Thomas, J. Mcnaught, M. Miwa, and S. Ananiadou, Using text mining for study identification in systematic reviews: a systematic review of current approaches, Systematic Reviews, vol.4, issue.1, p.5, 2015.

Z. Samaan, L. Mbuagbaw, D. Kosa, V. Borg-debono, R. Dillenburg et al., A systematic scoping review of adherence to reporting guidelines in health care literature, Journal of multidisciplinary healthcare, vol.6, pp.169-88, 2013.

K. F. Schulz, D. G. Altman, and D. Moher, Consort 2010 statement: updated guidelines for reporting parallel group randomised trials, BMJ, vol.340, 2010.

E. Slade, H. Drysdale, and B. Goldacre, Discrepancies between prespecified and reported outcomes, BMJ, 2015.

L. Turner, L. Shamseer, D. Altman, K. Schulz, and D. Moher, Does use of the consort statement impact the completeness of reporting of randomised controlled trials published in medical journals? a cochrane review, Systematic reviews, vol.1, p.60, 2012.

J. Weston, K. Dwan, D. Altman, M. Clarke, C. Gamble et al., Feasibility study to examine discrepancy rates in prespecified and reported outcomes in articles submitted to the bmj, BMJ Open, 2016.

A. Yavchitz, I. Boutron, A. Bafeta, I. Marroun, P. Charles et al., Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study, PLoS Med, 2012.

, Nous avons présenté l'état de l'art et nos premières expériences pour ces tâches. Pour chaque tâche, nous avons suggéré quelques directions possibles pour les travaux futurs. Pour évaluer nos algorithmes à base de règles décrits dans les articles ci-dessus et pour entrainer des algorithmes d'apprentissage automatique, un corpus annoté avec les informations pertinentes est nécessaire. Le chapitre 2 décrit nos efforts pour collecter un corpus d'articles biomédicaux et les annoter pour le spin et les informations d'appoint. Le papier a présenté un schéma d'annotation pour le spin et l'information liée, nos guidelines d'annotation et les difficultés que nous avons rencontré, Le chapitre 1 a présenté nos premières pas dans le développement d'algorithmes de TAL pour la détection automatique du spin dans des articles biomédicaux. Nous avons proposé un schéma pour un algorithme d'extraction automatique d'affirmations importants dans les résumés d'articles biomédicaux et des informations d'appoint possibles

, L'extraction des résultats déclarés (primaires) et rapportés est une tâche principale pour la détection de spin. Dans cet article, nous avons examiné l'état de l'art pour l'extraction des résultats. Nous avons présenté notre corpus annoté manuellement de 2 000 phrases avec résultats déclarés (primaires) et 1 940 phrases avec résultats rapportés, qui est disponible gratuitement. Nous avons comparé deux approches d'apprentissage profond: une approche d'adaptation (" fine-tuning ") simple et une approche utilisant des champs aléatoires conditionnels (CRF) et des réseaux récurrents bi-directionnels avec mémoire à long terme (Bi-LSTM), en conjonction avec des plongements lexicaux ("embeddings") de caractères et des plongements lexicaux dérivées de modèles linguistiques pré-appris, Le chapitre 3 a décrit nos expériences d'utilisation de l'apprentissage profond pour extraire les résultats d'un essai -variables surveillées au cours d'essais cliniques

, Les meilleurs résultats obtenus ont été la F-mesure au niveau des tokens de 88, p.52

, pour les résultats primaires (fine-tuned BioBERT) et de 79.42% pour les résultats rapportés

, Le chapitre 4 a décrit le développement d'un algorithme d'évaluation de la similarité sé-203

, Sur la base du corpus annoté pour les résultats primaires et rapportés (décrit dans le chapitre précédent), nous avons annoté des paires de résultats primaires et rapportés pour la similarité sémantique (sur une échelle binaire). Le corpus est disponible gratuitement. Nous avons créé un corpus étendu en ajoutant les variantes permettant de faire référence à un résultat (par exemple, l'utilisation d'un nom d'outil de mesure à la place de l'expression

, Pour l'approche de base, nous avons utilisé un nombre de mesures de similarité sémantique, basées sur des charactères, des tokens et des lemmes, des distances entre des expressions dans le réseau sémantique WordNet et des représentations vectorielles des expressions

, Nous avons entraîné et testé différents classificateurs d'apprentissage automatique en utilisant une combinaison de mesures de similarité en tant que traits. Enfin, nous avons utilisé une approche d'apprentissage profond consistant à adpater ("fine tuning") les représentations linguistiques profondes pré-apprises sur le corpus des paires de résultats. Nous avons testé plusieurs modèles de langue: BERT ( entraîné sur des textes de domaine général, BioBERT et SciBERT (entraînés respectivement sur le domaines biomédical et le domaine scientifique général

, Le meilleur résultat sur le corpus original a été montré par le modèle BioBERT, avec une F-mesure de 89.75%

, Le chapitre 5 a décrit les expériences d'utilisation des algorithmes d'extraction de résultats et d'évaluation de la similarité sémantique (décrits dans les deux chapitres précédents) pour développer un algorithme de détection de la substitution de résultat -en anglais "outcome switching" -un type de spin consistant en un changement injustifié (en omettant ou en ajoutant) des résultats définis d'un essai. Nous nous sommes concentrés sur la substitution de résultat primaire. Nous avons annoté un corpus avec les informations nécessaires à la détection de substitution de résultat : 2 000 phrases avec 1 694 résultats primaires; 1 940 phrases avec 2 251 résultats rapportés

, Nous avons utilisé une combinaison d'extraction d'informations, d'analyse de données structurées et de méthodes d'évaluation de la similarité sémantique pour identifier la substitution du résultat primaire. Les algorithmes d'évaluation de la similarité sémantique ont été évalués sur le corpus d'origine et sur un corpus étendu avec des variantes de référence à un résultat

, La meilleure performance obtenue était la F-mesure de 88.42% pour l'extraction des résultats PhD Portfolio Name PhD student: Anna Koroleva PhD period, 2016.

, Name PhD supervisor: Patrick Paroubek, Patrick Bossuyt PhD training Year Workload (Hours) in the 21st century. The editor-in-chief, vol.3, p.5

, From Government to Bench: How a funding agency spends government's science budget

, Parcours de l'après-thèse / what about post-thesis?, p.5, 2019.

, Peer-review -answering to reviewers and editors 2019 2 Devising your career plan: an alliance between your mind, your heart and your guts, p.1, 2019.

, Preparing job applications outside academia: optimizing your written and oral communication

, A review of basic statistical concepts: variability, uncertainty, confidence intervals 2016 1,5 A review of basic statistical concepts: p values, replicability 2016, vol.1, p.5

, Using causal diagrams to understand problems of confounding and selection bias, p.1, 2016.

, Effect measures, Effect modification and non-collapsibility. Adjustment for confounding, 20161.

, Identify causal effect parameters which our research is targeting / What assumptions are reasonable, how might we approach it? 2016 2 13th EUROLAN School on Natural Language Processing, vol.3, p.25, 2019.

, Advanced methods in Research on Research: Use of specific experimental study design in Research on, vol.1, p.5, 2017.

, Value of Qualitative Research; Introduction to Qualitative Research

, Collecting Data; Writing an Interview Guide, Qualitative Research Methods, p.33, 20171.

, Conducting an Interview; Qualitative Analysis; Analysing Transcribed interview Data, 2008.

, From quantitative to qualitative, vol.1, p.5

. Séminaire,

, Webinar on Entrepreneurship, p.1, 2018.

. Webinar, The current research climate: changing culture and the incentive systems

, Presentations Vers la détection automatique des affirmations inappropriées dans les articles scientifiques, 18e REncontres jeunes Chercheurs en Informatique pour le TAL, p.2017

, Automatic detection of inadequate claims in biomedical articles: first steps, 2017.

, On the contribution of specific entity detection and comparative construction to automatic spin detection in biomedical scientific publications. The Second Workshop on Processing Emotions, Decisions and Opinions, The 8th Language and Technology Conference, p.2017, 2017.

, Annotating Spin in Biomedical Scientific Publications: the case of Randomized Controlled, Trials (RCTs), 2018.

, Scientific rigour versus power to convince: an NLP approach to detecting distorted conclusions in biomedical, 2018.

, Demonstrating ConstruKT, a text annotation toolkit for generalized linguistic constructions applied to communication spin, LTC, vol.2019, 2019.

, Extracting relations between outcome and significance level in Randomized Controlled Trials (RCTs) publications. ACL BioNLP workshop, 2019.

, Analysing clinical trial outcomes in trial registries, 2019.

, A machine learning algorithm and tools for automatic detection of spin (distorted presentation of results) in articles reporting randomized controlled trials, ICTMC, pp.26-30, 2017.

, Workshop on Curative Power of MEdical Data, pp.12-13, 2017.

, The Second Workshop on Processing Emotions, Decisions and Opinions, 2017.

, months Secondment at the UK EQUATOR Network, 2018.

A. Koroleva, Towards automatic detection of inadequate claims in scientific articles, Vers la détection automatique des affirmations inappropriées dans les articles scientifiques, p.18

, REncontres jeunes Chercheurs en Informatique pour le TAL, pp.135-148, 2017.

A. Koroleva and P. Paroubek, Automatic detection of inadequate claims in biomedical articles: first steps, Proceedings of Workshop on Curative Power of MEdical Data, Constanta, 2017.

A. Koroleva and P. Paroubek, On the contribution of specific entity detection and comparative construction to automatic spin detection in biomedical scientific publications, Proceedings of The Second Workshop on Processing Emotions, Decisions and Opinions, p.2017, 2017.

A. Koroleva and P. Paroubek, Annotating Spin in Biomedical Scientific Publications: the case of Random Controlled Trials (RCTs), 2018.

A. Koroleva and P. Paroubek, Demonstrating ConstruKT, a text annotation toolkit for generalized linguistic constructions applied to communication spin, LTC 2019: Demo Session Anna Koroleva, Patrick Paroubek. Extracting relations between outcome and significance level in Randomized Controlled Trials (RCTs) publications. Proceedings of ACL BioNLP workshop, 2019.

A. Koroleva, S. Kamath, and P. Paroubek, Extracting primary and reported outcomes from articles reporting randomized controlled trials using pre-trained deep language representations

A. Koroleva and P. Paroubek, Measuring semantic similarity of clinical trial outcomes using deep pre-trained language representations, Journal of Biomedical Informatics -X, 2019.

A. Koroleva, P. Paroubek-;-sanjay, . Kamath, M. M. Patrick, P. Bossuyt et al., Can computers be taught to peer review and detect spin? Issues and challenges of a novel application of Natural Language Processing: a case study. Under revision Anna Koroleva

A. Koroleva, C. O. Parra, and P. Paroubek, On improving the implementation of automatic updating of systematic reviews, JAMIA Open, p.44, 2019.

A. Other, C. Koroleva, P. Masson, and . Paroubek, Analysing clinical trial outcomes in trial registries, 2019.

A. Koroleva and P. Paroubek, A machine learning algorithm and tools for automatic detection of spin (distorted presentation of results) in articles reporting randomized controlled trials, 2019.

A. Koroleva and P. Paroubek, Automating the detection of communication spin in scientific articles reporting Randomized Controlled Trials, preparation Contributing authors ? Patrick Paroubek (PP)

C. Limsi and U. Paris-saclay,

?. Patrick and M. M. Bossuyt, PMMB), co-supervisor Academic Medical Center

P. Sideview and . Risborough, PhD student LIMSI, Croatia ? Sanjay Kamath (SK)