Gabriella Kazai

Gabriella Kazai, Jaap Kamps, Natasa Milic-Frayling: An analysis of human factors and label accuracy in crowdsourcing relevance judgments. Inf. Retr. 16(2): 138-178 (2013)

Patrice Bellot, Timothy Chappell, Antoine Doucet, Shlomo Geva, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Monica Landoni, Maarten Marx, Véronique Moriceau, Josiane Mothe, G. Ramírez, Mark Sanderson, Eric SanJuan, Falk Scholer, Xavier Tannier, Martin Theobald, Matthew Trappett, Andrew Trotman, Qiuyue Wang: Report on INEX 2011. SIGIR Forum 46(1): 33-42 (2012)

Gabriella Kazai, Carsten Eickhoff, Peter Brusilovsky: Report on BooksOnline'11: 4th workshop on online books, complementary social media, and crowdsourcing. SIGIR Forum 46(1): 43-50 (2012)

Patrice Bellot, Timothy Chappell, Antoine Doucet, Shlomo Geva, Sairam Gurajada, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Monica Landoni, Maarten Marx, A. Mishra, Véronique Moriceau, Josiane Mothe, Michael Preminger, G. Ramírez, Mark Sanderson, Eric SanJuan, Falk Scholer, A. Schuh, Xavier Tannier, Martin Theobald, Matthew Trappett, Andrew Trotman, Qiuyue Wang: Report on INEX 2012. SIGIR Forum 46(2): 50-59 (2012)

Gabriella Kazai, Nick Craswell, Emine Yilmaz, Seyed M. M. Tahaghoghi: An analysis of systematic judging errors in information retrieval. CIKM 2012: 105-114

Marijn Koolen, Jaap Kamps, Gabriella Kazai: Social book search: comparing topical relevance judgements and book suggestions for evaluation. CIKM 2012: 185-194

Gabriella Kazai, Jaap Kamps, Natasa Milic-Frayling: The face of quality in crowdsourcing relevance labels: demographics, personality and labeling accuracy. CIKM 2012: 2583-2586

Gabriella Kazai, Monica Landoni, Carsten Eickhoff, Peter Brusilovsky: Booksonline'12: 5th workshop on online books, complementary social media and their impact. CIKM 2012: 2764-2765

Marijn Koolen, Gabriella Kazai, Jaap Kamps, Michael Preminger, Antoine Doucet, Monica Landoni: Overview of the INEX 2012 Social Book Search Track. CLEF (Online Working Notes/Labs/Workshop) 2012

Mehdi Hosseini, Ingemar J. Cox, Natasa Milic-Frayling, Gabriella Kazai, Vishwa Vinay: On Aggregating Labels from Multiple Crowd Workers to Infer Relevance of Documents. ECIR 2012: 182-194

Emine Yilmaz, Gabriella Kazai, Nick Craswell, Seyed M. M. Tahaghoghi: On judgments obtained from a commercial search engine. SIGIR 2012: 1115-1116

Antoine Doucet, Gabriella Kazai, Bodin Dresevic, Aleksandar Uzelac, Bogdan Radakovic, Nikola Todic: Setting up a competition framework for the evaluation of structure extraction from OCR-ed books. IJDAR 14(1): 45-52 (2011)

Leif Azzopardi, Dawei Song, Gabriella Kazai, Stephen Robertson, Stefan M. Rüger, Milad Shokouhi, Emine Yilmaz: Introduction to special issue on the second international conference on the theory of information retrieval. Inf. Retr. 14(1): 1-4 (2011)

David Alexander, Paavo Arvola, Thomas Beckers, Patrice Bellot, Timothy Chappell, Christopher M. De Vries, Antoine Doucet, Norbert Fuhr, Shlomo Geva, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Sangeetha Kutty, Monica Landoni, Véronique Moriceau, Richi Nayak, Ragnar Nordlie, Nils Pharo, Eric SanJuan, Ralf Schenkel, Andrea Tagarelli, Xavier Tannier, James A. Thom, Andrew Trotman, Johanna Vainio, Qiuyue Wang, Chen Wu: Report on INEX 2010. SIGIR Forum 45(1): 2-17 (2011)

Gabriella Kazai, Peter Brusilovsky: Report on the BooksOnline'10: third workshop on research advances in large digital book repositories and complementary media. SIGIR Forum 45(1): 25-32 (2011)

Gabriella Kazai, Jaap Kamps, Natasa Milic-Frayling: Worker types and personality traits in crowdsourcing relevance labels. CIKM 2011: 1941-1944

Gabriella Kazai, Carsten Eickhoff, Peter Brusilovsky: BooksOnline'11: 4th workshop on online books, complementary social media, and crowdsourcing. CIKM 2011: 2619-2620

Gabriella Kazai: In Search of Quality in Crowdsourcing for Search Engine Evaluation. ECIR 2011: 165-176

Antoine Doucet, Gabriella Kazai, Jean-Luc Meunier: ICDAR 2011 Book Structure Extraction Competition. ICDAR 2011: 1501-1505

Gabriella Kazai, Jaap Kamps, Marijn Koolen, Natasa Milic-Frayling: Crowdsourcing for book search evaluation: impact of hit design on comparative system ranking. SIGIR 2011: 205-214

Paul Bennett, Ece Kamar, Gabriella Kazai: MSRC at TREC 2011 Crowdsourcing Track. TREC 2011

Gabriella Kazai, Carsten Eickhoff, Peter Brusilovsky (Eds.): Proceedings of the 4th ACM Workshop on Online books, complementary social media and crowdsourcing, BooksOnline 2011, Glasgow, United Kingdom, October 24, 2011. ACM 2011, isbn 978-1-4503-0961-5

Thomas Beckers, Patrice Bellot, Gianluca Demartini, Ludovic Denoyer, Christopher M. De Vries, Antoine Doucet, Khairun Nisa Fachry, Norbert Fuhr, Patrick Gallinari, Shlomo Geva, Wei Chi Huang, Tereza Iofciu, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Sangeetha Kutty, Monica Landoni, Miro Lehtonen, Véronique Moriceau, Richi Nayak, Ragnar Nordlie, Nils Pharo, Eric SanJuan, Ralf Schenkel, Xavier Tannier, Martin Theobald, James A. Thom, Andrew Trotman, Arjen P. de Vries: Report on INEX 2009. SIGIR Forum 44(1): 38-57 (2010)

Gabriella Kazai, Natasa Milic-Frayling, Tim Haughton, Natalia Manola, Katerina Iatropoulou, Antonis Lempesis, Paolo Manghi, Marko Mikulicic: Connecting the local and the online in information management. CIKM 2010: 1941-1942

Gabriella Kazai, Peter Brusilovsky: 3rd BooksOnline workshop: research advances in large digital book repositories and complementary media. CIKM 2010: 1967-1968

Cathal Gurrin, Yulan He, Gabriella Kazai, Udo Kruschwitz, Suzanne Little, Thomas Roelleke, Stefan M. Rüger, Keith van Rijsbergen: Recent Developments in Information Retrieval. ECIR 2010: 1-9

Gabriella Kazai, Paolo Manghi, Katerina Iatropoulou, Tim Haughton, Marko Mikulicic, Antonis Lempesis, Natasa Milic-Frayling, Natalia Manola: Architecture for a Collaborative Research Environment Based on Reading List Sharing. ECDL 2010: 294-306

Gabriella Kazai, Marijn Koolen, Jaap Kamps, Antoine Doucet, Monica Landoni: Overview of the INEX 2010 Book Track: Scaling Up the Evaluation Using Crowdsourcing. INEX 2010: 98-117

Gabriella Kazai, Peter Brusilovsky (Eds.): Proceedings of the 2010 ACM Workshop on Research Advances in Large Digital Book Repositories and Complementary Media, BooksOnline 2010, Toronto , ON, Canada - October 26, 2010. ACM 2010, isbn 978-1-4503-0377-4

Cathal Gurrin, Yulan He, Gabriella Kazai, Udo Kruschwitz, Suzanne Little, Thomas Roelleke, Stefan M. Rüger, Keith van Rijsbergen (Eds.): Advances in Information Retrieval, 32nd European Conference on IR Research, ECIR 2010, Milton Keynes, UK, March 28-31, 2010. Proceedings. Lecture Notes in Computer Science 5993, Springer 2010, isbn 978-3-642-12274-3

Gianluca Demartini, Ludovic Denoyer, Antoine Doucet, Khairun Nisa Fachry, Patrick Gallinari, Shlomo Geva, Darren Wei Che Huang, Tereza Iofciu, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Monica Landoni, Ragnar Nordlie, Nils Pharo, Ralf Schenkel, Martin Theobald, Andrew Trotman, Arjen P. de Vries, Alan Woodley, Jianhan Zhu: Report on INEX 2008. SIGIR Forum 43(1): 17-36 (2009)

Gerard Oleksik, Max L. Wilson, Craig S. Tashman, Eduarda Mendes Rodrigues, Gabriella Kazai, Gavin Smyth, Natasa Milic-Frayling, Rachel Jones: Lightweight tagging expands information and activity management practices. CHI 2009: 279-288

Chung Tong Lee, Vishwa Vinay, Eduarda Mendes Rodrigues, Gabriella Kazai, Natasa Milic-Frayling, Aleksandar Ignjatovic: Measuring system performance and topic discernment using generalized adaptive-weight mean. CIKM 2009: 2033-2036

Antoine Doucet, Gabriella Kazai, Bodin Dresevic, Aleksandar Uzelac, Bogdan Radakovic, Nikola Todic: ICDAR 2009 Book Structure Extraction Competition. ICDAR 2009: 1408-1412

Gabriella Kazai, Antoine Doucet, Marijn Koolen, Monica Landoni: Overview of the INEX 2009 Book Track. INEX 2009: 145-159

Gabriella Kazai, Natasa Milic-Frayling: Effects of Social Approval Votes on Search Performance. ITNG 2009: 1554-1559

Gabriella Kazai, Natasa Milic-Frayling, Jamie Costello: Towards methods for the collective gathering and quality control of relevance assessments. SIGIR 2009: 452-459

Chung Tong Lee, Eduarda Mendes Rodrigues, Gabriella Kazai, Natasa Milic-Frayling, Aleksandar Ignjatovic: Model for Voter Scoring and Best Answer Selection in Community Q&A Services. Web Intelligence 2009: 116-123

Marijn Koolen, Gabriella Kazai, Nick Craswell: Wikipedia pages as entry points for book search. WSDM 2009: 44-53

Gabriella Kazai: INitiative for the Evaluation of XML Retrieval. Encyclopedia of Database Systems 2009: 1531-1537

Leif Azzopardi, Gabriella Kazai, Stephen E. Robertson, Stefan M. Rüger, Milad Shokouhi, Dawei Song, Emine Yilmaz (Eds.): Advances in Information Retrieval Theory, Second International Conference on the Theory of Information Retrieval, ICTIR 2009, Cambridge, UK, September 10-12, 2009, Proceedings. Lecture Notes in Computer Science 5766, Springer 2009, isbn 978-3-642-04416-8

Gabriella Kazai, Antoine Doucet: Overview of the INEX 2007 Book Search track: BookSearch '07. SIGIR Forum 42(1): 2-15 (2008)

Mir Sadek Ali, Mariano P. Consens, Gabriella Kazai, Mounia Lalmas: Structural relevance: a common basis for the evaluation of structured document retrieval. CIKM 2008: 1153-1162

Gabriella Kazai, Natasa Milic-Frayling: Trust, authority and popularity in social information retrieval. CIKM 2008: 1503-1504

Hengzhi Wu, Gabriella Kazai, Michael Taylor: Book Search Experiments: Investigating IR Methods for the Indexing and Retrieval of Books. ECIR 2008: 234-245

Gabriella Kazai, Antoine Doucet, Monica Landoni: New Tasks on Collections of Digitized Books. ECDL 2008: 410-412

Gabriella Kazai, Antoine Doucet, Monica Landoni: Overview of the INEX 2008 Book Track. INEX 2008: 106-123

Paul B. Kantor, Gabriella Kazai, Natasa Milic-Frayling, Ross Wilkinson (Eds.): Proceedings of the 2008 ACM Workshop on Research Advances in Large Digital Book Repositories, BooksOnline 2008, Napa Valley, California, USA, October 30, 2008. ACM 2008, isbn 978-1-60558-249-8

Jaap Kamps, Jovan Pehcevski, Gabriella Kazai, Mounia Lalmas, Stephen Robertson: INEX 2007 Evaluation Measures. INEX 2007: 24-33

Gabriella Kazai, Antoine Doucet: Overview of the INEX 2007 Book Search Track (BookSearch'07). INEX 2007: 148-161

Thomas Rölleke, Theodora Tsikrika, Gabriella Kazai: A general matrix framework for modelling Information Retrieval. Inf. Process. Manage. 42(1): 4-30 (2006)

Norbert Gövert, Norbert Fuhr, Mounia Lalmas, Gabriella Kazai: Evaluating the effectiveness of content-oriented XML retrieval methods. Inf. Retr. 9(6): 699-722 (2006)

Mounia Lalmas, Gabriella Kazai: Report on the ad-hoc track of the INEX 2005 workshop. SIGIR Forum 40(1): 49-57 (2006)

Gabriella Kazai, Mounia Lalmas: eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval. ACM Trans. Inf. Syst. 24(4): 503-542 (2006)

Mounia Lalmas, Gabriella Kazai, Jaap Kamps, Jovan Pehcevski, Benjamin Piwowarski, Stephen Robertson: INEX 2006 Evaluation Measures. INEX 2006: 20-34

Gabriella Kazai: Choosing an Ideal Recall-Base for the Evaluation of the Focused Task: Sensitivity Analysis of the XCG Evaluation Measures. INEX 2006: 35-44

Norbert Fuhr, Mounia Lalmas, Saadia Malik, Gabriella Kazai (Eds.): Advances in XML Information Retrieval and Evaluation, 4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005, Dagstuhl Castle, Germany, November 28-30, 2005, Revised Selected Papers. Lecture Notes in Computer Science 3977, Springer 2006, isbn 3-540-34962-6

Saadia Malik, Gabriella Kazai, Mounia Lalmas, Norbert Fuhr: Overview of INEX 2005. INEX 2005: 1-15

Gabriella Kazai, Mounia Lalmas: INEX 2005 Evaluation Measures. INEX 2005: 16-29

Roelof van Zwol, Gabriella Kazai, Mounia Lalmas: INEX 2005 Multimedia Track. INEX 2005: 497-510

Gwenaël Durand, Gabriella Kazai, Mounia Lalmas, Uwe Rauschenbach, Patrick Wolf: A Metadata Model Supporting Scalable Interactive TV Services. MMM 2005: 386-391

Gabriella Kazai, Mounia Lalmas, Norbert Fuhr, Norbert Gövert: A report on the first year of the INitiative for the Evaluation of XML retrieval. JASIST 55(6): 551-556 (2004)

Gabriella Kazai, Sherezad Masood, Mounia Lalmas: A Study of the Assessment of Relevance for the INEX'02 Test Collection. ECIR 2004: 296-310

Gabriella Kazai, Mounia Lalmas, Arjen P. de Vries: Reliability Tests for the XCG and inex-2002 Metrics. INEX 2004: 60-72

Arjen P. de Vries, Gabriella Kazai, Mounia Lalmas: Tolerance to Irrelevance: A User-effort Evaluation of Retrieval Systems without Predefined Retrieval Unit. RIAO 2004: 463-473

Gabriella Kazai, Mounia Lalmas, Arjen P. de Vries: The overlap problem in content-oriented XML retrieval evaluation. SIGIR 2004: 72-79

Gabriella Kazai, Mounia Lalmas, Jane Reid: Construction of a Test Collection for the Focussed Retrieval of Structured Documents. ECIR 2003: 88-103

Gabriella Kazai, Norbert Gövert, Mounia Lalmas, Norbert Fuhr: The INEX Evaluation Initiative. Intelligent Search on XML Data 2003: 279-293

Thomas Rölleke, Mounia Lalmas, Gabriella Kazai, Ian Ruthven, Stefan Quicker: The Accessibility Dimension for Structured Document Retrieval. ECIR 2002: 284-302

Norbert Gövert, Gabriella Kazai: Overview of the Initiative for the Evaluation of XML retrieval (INEX) 2002. INEX Workshop 2002: 1-17

Gabriella Kazai, Thomas Rölleke: A Scalable Architecture for XML Retrieval. INEX Workshop 2002: 49-56

Gabriella Kazai, Mounia Lalmas, Thomas Rölleke: Focussed Structured Document Retrieval. SPIRE 2002: 241-247

Norbert Fuhr, Norbert Gövert, Gabriella Kazai, Mounia Lalmas (Eds.): Proceedings of the First Workshop of the INitiative for the Evaluation of XML Retrieval (INEX), Schloss Dagstuhl, Germany, December 9-11, 2002. 2002

Thomas Rölleke, Ralf Lübeck, Gabriella Kazai: The HySpirit Retrieval Platform. SIGIR 2001: 454

Gabriella Kazai, Mounia Lalmas, Thomas Rölleke: A Model for the Representation and Focussed Retrieval of Structured Documents Based on Fuzzy Aggregation. SPIRE 2001: 123-135