Publications

Filter by Type

Filter by Year

Sort by Year

On the Ordering of Pooled Web Pages, Gold Assessments, and Bronze Assessments

Sakai, T., Tao, S., Chen, N., Li, Y., Maistro, M., Chu, Z., and Ferro, N. (2024)
Int. Journal Paper ACM Transactions on Information Systems (TOIS), 42(1):23:1--23:31.

iDPP@CLEF 2024: The Intelligent Disease Progression Prediction Challenge

Aidos, H., Bergamaschi, S., Cavalla, P., Chiò, A., Dagliati, A., Di Camillo, B., de Carvalho, M., Ferro, N., Fariselli, P., García Dominguez, J. M., Madeira, S. C., and Tavazzi, E. (2024).
Int. Conference Paper In Nazli, G., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., and Ounis, I., editors, Advances in Information Retrieval. Proc. 46th European Conference on IR Research (ECIR 2024) - Part VI, pages 53-59. Lecture Notes in Computer Science (LNCS) 14613, Springer, Heidelberg, Germany

Query Obfuscation for Information Retrieval through Differential Privacy

Faggioli, G. and Ferro, N. (2024).
Int. Conference Paper In Nazli, G., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., and Ounis, I., editors, Advances in Information Retrieval. Proc. 46th European Conference on IR Research (ECIR 2024) - Part I, pages 278-294. Lecture Notes in Computer Science (LNCS) 14608, Springer, Heidelberg, Germany

Dimension Importance Estimation for Dense Information Retrieval

Faggioli, G., Ferro, N., Perego, R., and Tonellotto, N. (2024).
Int. Conference Paper In Hui Yang, G., H., W., Han, S., Hauff, C., Zuccon, G., and Zhang, Y., editors, Proc. 47th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024). ACM Press, New York, USA

Quantum Computing for Information Retrieval and Recommender Systems

Ferrari Dacrema, M., Pasin, A., Cremonesi, P., and Ferro, N. (2024).
Int. Conference Paper In Nazli, G., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., and Ounis, I., editors, Advances in Information Retrieval. Proc. 46th European Conference on IR Research (ECIR 2024) - Part V, pages 358-362. Lecture Notes in Computer Science (LNCS) 14612, Springer, Heidelberg, Germany

Using and Evaluating Quantum Computing for Information Retrieval and Recommender Systems

Ferrari Dacrema, M., Pasin, A., Cremonesi, P., and Ferro, N. (2024).
Int. Conference Paper In Hui Yang, G., H., W., Han, S., Hauff, C., Zuccon, G., and Zhang, Y., editors, Proc. 47th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024). ACM Press, New York, USA

The CLEF Monster Track: One Lab to Rule Them All

Ferro, N., Gonzalo, J., Karlgren, J., and Müller, H. (2024).
Int. Conference Paper In Nazli, G., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., and Ounis, I., editors, Advances in Information Retrieval. Proc. 46th European Conference on IR Research (ECIR 2024) - Part VI, pages 11-18. Lecture Notes in Computer Science (LNCS) 14613, Springer, Heidelberg, Germany

Uncontextualized significance considered dangerous

Ferro, N. and Sanderson, M. (2024).
Int. Conference Paper In Hui Yang, G., H., W., Han, S., Hauff, C., Zuccon, G., and Zhang, Y., editors, Proc. 47th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024). ACM Press, New York, USA

QuantumCLEF - Quantum Computing at CLEF

Pasin, A., Ferrari Dacrema, M., Cremonesi, P., and Ferro, N. (2024).
Int. Conference Paper In Nazli, G., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., and Ounis, I., editors, Advances in Information Retrieval. Proc. 46th European Conference on IR Research (ECIR 2024) - Part V, pages 482-489. Lecture Notes in Computer Science (LNCS) 14612, Springer, Heidelberg, Germany

Evaluating Differential Privacy Approaches for Information Retrieval

Faggioli, G. and Ferro, N. (2024).
Nat. Conference Paper In Bernasconi, E., Mannocci, A., Poggi, A., Salatino, A., and Silvello, G. editors, Proc. 20th Conference on Information and Research science Connecting to Digital and Library science (IRCDL 2024), pages 41-46. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3643 ISSN 1613-0073.

Frontiers of Information Access Experimentation for Research and Education (Dagstuhl Seminar 23031)

Bauer, C., Carterette, B., Ferro, N., Fuhr, N., and Faggioli, G. (2023).
Journal w/o Peer Review Paper Dagstuhl Reports, 13(1):68-154.

An in-depth investigation on the behavior of measures to quantify reproducibility

Maistro, M., Breuer, T., Schaer, P., and Ferro, N. (2023)
Int. Journal Paper Information Processing & Management, 60(3):103332:1-103332:39

L'accesso all'informazione: i sistemi, le tecnologie, le sfide

Ferro, N. (2023)
Nat. Journal Paper Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina. Parte II: Memorie della Classe di Scienze Matematiche, Fisiche e Naturali, CXXXIV:39-61

Report on the 14th Conference and Labs of the Evaluation Forum (CLEF 2023): Experimental IR Meets Multilinguality, Multimodality, and Interaction

Aliannejadi, M., Arampatzis, A., Faggioli, G., Ferro, N., Giachanou, A., Kanoulas, E., Li, D., Tsikrika, T., Vlachos, M., and Vrochidis, S. (2023).
Journal w/o Peer Review Paper SIGIR Forum, 57(2):16:1-16:16.

Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Bauer, C., Carterette, B., Ferro, N., Fuhr, N., Beel, J., Breuer, T., Clarke, C. L. A., Crescenzi, A., Demartini, G., Di Nunzio, G.~M., Dietz, L., Faggioli, G., Ferwerda, B., Fröbe, M., Hagen, M., Hanbury, A., Hauff, C., Jannach, D., Kando, N., Kanoulas, E., Knijnenburg, B. P., Kruschwitz, U., Li, M., Maistro, M., Michiels, L., Papenmeier, A., Potthast, M., Rosso, P., Said, A., Schaer, P., Seifert, C., Spina, D., Stein, B., Tintarev, N., Urbano, J., Wachsmuth, H., Willemsen, M.~C., and Zobel, J. (2023).
Journal w/o Peer Review Paper SIGIR Forum, 57(1):7:1-7:28.

Report on the 1st Workshop on Query Performance Prediction and Its Evaluation in New Tasks (QPP++ 2023) at ECIR 2023

Faggioli, G., Ferro, N., Mothe, J., Raiber, F., and Fröbe, M. (2023).
Journal w/o Peer Review Paper SIGIR Forum, 57(1):12:1--12:7.

iDPP@CLEF 2023: The Intelligent Disease Progression Prediction Challenge

Aidos, H., Bergamaschi, S., Cavalla, P., Chiò, A., Dagliati, A., Di Camillo, B., de Carvalho, M., Ferro, N., Fariselli, P., García Dominguez, J. M., Madeira, S. C., and Tavazzi, E. (2023).
Int. Conference Paper In Kamps, J., Goeuriot, L., Crestani, F., Maistro, M., Joho, H., Davis, B., Gurrin, C., Kruschwitz, U., and Caputo, A., editors, Advances in Information Retrieval. Proc. 45th European Conference on IR Research (ECIR 2023) - Part III, pages 491-498. Lecture Notes in Computer Science (LNCS) 13982, Springer, Heidelberg, Germany

DECAF: a Modular and Extensible Conversational Search Framework

Alessio, M., Faggioli, G., and Ferro, N. (2023).
Int. Conference Paper In Chen, H.-H., Duh, W.-J., Huang, H.-H., Kato, M.~P., Mothe, J., and Poblete, B., editors, Proc. 46th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023), pages 3075-3085. ACM Press, New York, USA

Shared Tasks as Tutorials: A Methodical Approach

Elstner, T., Loebe, F., Ajjour, Y., Akiki, C., Bondarenko, A., Fröbe, M., Gienapp, L., Kolyada, N., Mohr, J., Sandfuchs, S., Wiegmann, M., Frochte, J., Ferro, N., Hofmann, S., Stein, B., Hagen, M., and Potthast, M. (2023).
Int. Conference Paper In Williams, B., Chen, Y., and Neville, J., editors, Proc. 37th AAAI Conference on Artificial Intelligence (AAAI 2023) and 13th Symposium on Educational Advances in Artificial Intelligence (EAAI 2023), volume 37, number 13, pages 15807–15815. Association for the Advancement of Artificial Intelligence (AAAI), Washington, USA

QPP++ 2023: Query-Performance Prediction and Its Evaluation in New Tasks

Faggioli, G., Ferro, N., Mothe, J., and Raiber, F. (2023).
Int. Conference Paper In Kamps, J., Goeuriot, L., Crestani, F., Maistro, M., Joho, H., Davis, B., Gurrin, C., Kruschwitz, U., and Caputo, A., editors, Advances in Information Retrieval. Proc. 45th European Conference on IR Research (ECIR 2023) - Part III, pages 388-391. Lecture Notes in Computer Science (LNCS) 13982, Springer, Heidelberg, Germany

Towards Query Performance Prediction for Neural Information Retrieval: Challenges and Opportunities

Faggioli, G., Formal, T., Lupart, S., Marchesin, S., Clinchant, S., Ferro, N., and Piwowarski, B. (2023).
Int. Conference Paper In Yoshioka, M., Kiseleva, J., and Aliannejadi, M., editors, Proc. 9th ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR 2023), pages 51-63. ACM Press, New York, USA

Query Performance Prediction for Neural IR: Are We There Yet?

Faggioli, G., Formal, T., Marchesin, S., Clinchant, S., Ferro, N., and Piwowarski, B. (2023).
Int. Conference Paper In Kamps, J., Goeuriot, L., Crestani, F., Maistro, M., Joho, H., Davis, B., Gurrin, C., Kruschwitz, U., and Caputo, A., editors, Advances in Information Retrieval. Proc. 45th European Conference on IR Research (ECIR 2023) - Part I, pages 232-248. Lecture Notes in Computer Science (LNCS) 13980, Springer, Heidelberg, Germany

A Geometric Framework for Query Performance Prediction in Conversational Search

Faggioli, G., Ferro, N., Muntean, C. I., Perego, R., and Tonellotto, N. (2023).
Int. Conference PaperBest Paper Award Honorable Mention In Chen, H.-H., Duh, W.-J., Huang, H.-H., Kato, M. P., Mothe, J., and Poblete, B., editors, Proc. 46th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023), pages 1355-1365. ACM Press, New York, USA

Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2023

Faggioli, G., Guazzo, A., Marchesin, S., Menotti, L., Trescato, I., Aidos, H., Bergamaschi, R., Birolo, G., Cavalla, P., Chiò, A., Dagliati, A., de Carvalho, M., Di Nunzio, G. M., Fariselli, P., García Dominguez, J. M., Gromicho, M., Longato, E., Madeira, S. C., Manera, U., Silvello, G., Tavazzi, E., Tavazzi, E., Vettoretti, M., Di Camillo, B., and Ferro, N. (2023)
Int. Conference Paper In Arampatzis, A., Kanoulas, E., Tsikrika, T., Vrochidis, S., Giachanou, A., Li, D., Aliannejadi, M., Vlachos, M., Faggioli, G., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Fourteenth International Conference of the CLEF Association (CLEF 2023), pages 343-369. Lecture Notes in Computer Science (LNCS) 14163, Springer, Heidelberg, Germany

DAVI: a Dataset for Automatic Variant Interpretation

Longhin, F., Guazzo, A., Longato, E., Ferro, N., and Di Camillo, B. (2023).
Int. Conference Paper In Arampatzis, A., Kanoulas, E., Tsikrika, T., Vrochidis, S., Giachanou, A., Li, D., Aliannejadi, M., Vlachos, M., Faggioli, G., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Fourteenth International Conference of the CLEF Association (CLEF 2023), pages 85-96. Lecture Notes in Computer Science (LNCS) 14163, Springer, Heidelberg, Germany

How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods

Otero, D., Parapar, J., and Ferro, N. (2023).
Int. Conference Paper In Frommholz, I., Hopfgartner, F., Lee, M., Oakes, M., Lalmas, M., Zhang, M., and Santos, R., editors, Proc. 32nd International Conference on Information and Knowledge Management (CIKM 2023), pages 1960-1970. ACM Press, New York, USA

qCLEF: a Proposal to Evaluate Quantum Annealing for Information Retrieval and Recommender Systems

Pasin, A., Ferrari Dacrema, M., Cremonesi, P., and Ferro, N. (2023).
Int. Conference Paper In Arampatzis, A., Kanoulas, E., Tsikrika, T., Vrochidis, S., Giachanou, A., Li, D., Aliannejadi, M., Vlachos, M., Faggioli, G., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Fourteenth International Conference of the CLEF Association (CLEF 2023), pages 97-108. Lecture Notes in Computer Science (LNCS) 14163, Springer, Heidelberg, Germany

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Fourteenth International Conference of the CLEF Association (CLEF 2023)

Arampatzis, A., Kanoulas, E., Tsikrika, T., Vrochidis, S., Giachanou, A., Li, D., Aliannejadi, M., Vlachos, M., Faggioli, G., and Ferro, N., editors (2023).
Editorship Lecture Notes in Computer Science (LNCS) 14163, Springer, Heidelberg, Germany

CLEF 2023 Working Notes

Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors (2023).
Editorship CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

Proc. 31st Italian Symposium on Advanced Database Systems (SEBD 2023)

Calvanese, D., Diamantini, C., Faggioli, G., Ferro, N., Marchesin, S., Silvello, G., and Tanca, L., editors (2023).
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3478, ISSN 1613-0073

Proc. 1st International Workshop on Query Performance Prediction and Its Evaluation in New Tasks (QPP++ 2023)

Faggioli, G., Ferro, N., Mothe, J., and Raiber, F., editors (2023)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3366, ISSN 1613-0073

SKET: an Unsupervised Knowledge Extraction Tool to Empower Digital Pathology Applications

Di Nunzio, G. M., Ferro, N., Giachelle, F., Irrera, O., Marchesin, S., and Silvello, G. (2023).
Nat. Conference Paper In Falcon, A., Ferilli, S., Bardi, A., Marchesin, S., and Redavid, D., editors, Proc. 19th Conference on Information and Research science Connecting to Digital and Library science (IRCDL 2023), pages 144-152. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3365 ISSN 1613-0073.

IR Systems Evaluation via Generalized Linear Models

Faggioli, G., Ferro, N., and Fuhr, N. (2023)
Nat. Conference Paper In Nardini, F. M., Tonellotto, N., Faggioli, G., and Ferrara, A., editors Proc. 13th Italian Information Retrieval Workshop (IIR 2023), pages 105-110. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3448, ISSN 1613-0073.

A Modular Framework for Conversational Search Reproducible Experimentation

Alessio, M., Faggioli, G., and Ferro, N. (2023)
Nat. Conference Paper In Calvanese, D., Diamantini, C., Faggioli, G., Ferro, N., Marchesin, S., Silvello, G., and Tanca, L., editors Proc. 31st Italian Symposium on Advanced Database Systems (SEBD 2023), pages 349-359. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3478, ISSN 1613-0073.

A Spatial Approach to Predict Performance of Conversational Search Systems

Faggioli, G., Ferro, N., Muntean, C. I., Perego, R., and Tonellotto, N. (2023)
Nat. Conference Paper In Nardini, F. M., Tonellotto, N., Faggioli, G., and Ferrara, A., editors Proc. 13th Italian Information Retrieval Workshop (IIR 2023), pages 41-46. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3448, ISSN 1613-0073.

On the Limitations of Query Performance Prediction for Neural IR

Faggioli, G., Formal, T., Marchesin, S., Clinchant, S., Ferro, N., and Piwowarski, B. (2023)
Nat. Conference Paper In Calvanese, D., Diamantini, C., Faggioli, G., Ferro, N., Marchesin, S., Silvello, G., and Tanca, L., editors Proc. 31st Italian Symposium on Advanced Database Systems (SEBD 2023), pages 379-390. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3478, ISSN 1613-0073.

SEUPD@CLEF: Team CLOSE on Temporal Persistence of IR Systems' Performance

Antolini, G., Boscolo, N., Cazzaro, M., Martinelli, M., Safavi, S., Shami, F., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2368-2395. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUNIPD@CLEF: Team JIHUMING on Enhancing Search Engine Performance with Character N-Grams, Query Expansion, and Named Entity Recognition

Atabek, I., Chen, H., Moncada-Ramírez, J., Santini, N., Zago, G., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2204-2221. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team GWCA on Longitudinal Evaluation of IR Systems by Using Query Expansion and Learning To Rank

Bellin, L., Carè, A.~A., Martini, M., Pepaj, M.~T., Salvalaio, M., Segala, A., Tognon, M., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2222-2238. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: RAFJAM on Longitudinal Evaluation of Model Performance

Bolzonella, A., Broetto, R., Gasparini, M., Sadat, F., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2239-2251. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team FADERIC on A Query Expansion and Reranking Approach for the LongEval Task

Bolzonello, E., Marchiori, C., Moschetta, D., Trevisiol, R., Zanini, F., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2252-2280. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team NEON. A Memoryless Approach To Longitudinal Evaluation

Bortolin, S., Ceccon, G., Czaczkes, G., Pastore, A., Renna, P., Zerbo, G., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2281-2305. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team Squid on LongEval-Retrieval

Cardillo, V., Dorizza, A., Maglie, M., Mameli, D., Rossi, G., Russo, M., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2306-2337. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team DARDS - IR System for Short and Long Term Retrieval

Carlesso, D., Gobbo, R., Merlo, S., Pomaro, A., Spinosa, D., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2338-2367. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team HIBALL on Incremental Information Retrieval System with RRF and BERT

Ceccato, A., Fabbian, L., Huang, B.-W., Ullah Khan, I., Singh, H., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2396-2415. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

SEUPD@CLEF: Team QEVALS on Information Retrieval Adapted to the Temporal Evolution of Web Documents

D'Alberton, E., Fincato, S., Lenartavicius, V., Pallante, L., Qiu, Y. J., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 2416-2431. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

Overview of iDPP@CLEF 2023: The Intelligent Disease Progression Prediction Challenge

Faggioli, G., Guazzo, A., Marchesin, S., Menotti, L., Trescato, I., Aidos, H., Bergamaschi, R., Birolo, G., Cavalla, P., Chiò, A., Dagliati, A., de Carvalho, M., Di Nunzio, G. M., Fariselli, P., García Dominguez, J. M., Gromicho, M., Longato, E., Madeira, S. C., Manera, U., Silvello, G., Tavazzi, E., Tavazzi, E., Vettoretti, M., Di Camillo, B., and Ferro, N. (2023)
Int. Workshop Paper In Aliannejadi, M., Faggioli, G., Ferro, N., and Vlachos, M., editors, CLEF 2023 Working Notes, pages 1123-1164. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073

Overview of the NTCIR-17 FairWeb-1 Task

Tao, S., Chen, N., Sakai, T., Chu, Z., Arai, H., Soboroff, I., Ferro, N., and Maistro, M. (2023).
Int. Workshop Paper In Dou, Z., Kando, N., Kato, M.~P., Minamiyama, Y., Takaku, M., and Yamamoto, T., editors, Proc. 17th NTCIR Conference on Evaluation of Information Access Technologies (NTCIR-17). National Institute of Informatics, Tokyo, Japan

Topic Difficulty: Collection and Query Formulation Effects

Culpepper, J. S., Faggioli, G., Ferro, N., and Kurland, O. (2022)
Int. Journal Paper ACM Transactions on Information Systems (TOIS), 40(1):19:1-19:36

sMARE: a New Paradigm to Evaluate and Understand Query Performance Prediction Methods

Faggioli, G., Zendel, O., Culpepper, J. S., Ferro, N., and Scholer, F. (2022)
Int. Journal Paper Information Retrieval Journal, 25(2):94-122.

Report on the 13th Conference and Labs of the Evaluation Forum (CLEF 2022): Experimental IR Meets Multilinguality, Multimodality, and Interaction

Barrón-Cedeño, A., Da San Martino, G., Degli Esposti, M., Faggioli, G., Ferro, N., Hanbury, A., Macdonald, C., Pasi, G., Potthast, M., and Sebastiani, F. (2022).
Journal w/o Peer Review Paper SIGIR Forum, 56(2):13:1-13:15

A Framework to Evaluate the Quality of Integrated Datasets

Del Buono, F., Faggioli, G., Paganelli, M., Baraldi, A., Guerra, F., and Ferro, N. (2022).
Journal w/o Peer Review Paper ACM SIGAPP Applied Computing Review, 22(4):5-23

A Dependency-Aware Utterances Permutation Strategy to Improve Conversational Evaluation

Faggioli, G., Ferrante, M., Ferro, N., Perego, R., and Tonellotto, N. (2022)
Int. Conference Paper In Hagen, M., Verberne, S., Macdonald, C., Seifert, C., Balog, K., Nørvåg, K., and Setty, V., editors, Advances in Information Retrieval. Proc. 44th European Conference on IR Research (ECIR 2022), pages 184-198. Lecture Notes in Computer Science (LNCS) 13185, Springer, Heidelberg, Germany

Detecting Significant Differences Between Information Retrieval Systems via Generalized Linear Models

Faggioli, G., Ferro, N., and Fuhr, N. (2022)
Int. Conference Paper In Al Hasan, M., Xiong, L., Chirkova, R., Agichtein, E., and Zaki, M., editors, Proc. 31st International Conference on Information and Knowledge Management (CIKM 2022), pages 446-456. ACM Press, New York, USA

Question Answering-Based Query Expansion for Conversational Search: IIIA@UNIPD at TREC CAsT 2022

Faggioli, G., Ferro, N., and Romanello, M. (2023)
Int. Conference Paper In Soboroff, I. and Ellis, A., editors, The Thirty-First Text REtrieval Conference Proceedings (TREC 2022). National Institute of Standards and Technology (NIST), Special Publication 500-338, Washington, USA

Towards Feature Selection for Ranking and Classification Exploiting Quantum Annealers

Ferrari Dacrema, M., Moroni, F., Nembrini, R., Ferro, N., Faggioli, G., and Cremonesi, P. (2022).
Int. Conference Paper In Amigó, E., Castells, P., Gonzalo, J., Carterette, B. A., Culpepper, J. S., and Kazai, G., editors, Proc. 45th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2022), pages 2814-2824. ACM Press, New York, USA

How do you Test a Test? A Multifaceted Examination of Significance Tests

Ferro, N. and Sanderson, M. (2022)
Int. Conference Paper In Candan, K. S., Liu, H., Akoglu, L., Dong, X. L., and Tang, J., editors, Proc. 15th ACM International Conference on Web Searching and Data Mining (WSDM 2022), pages 280-288. ACM Press, New York, USA

Intelligent Disease Progression Prediction: Overview of iDPP@CLEF 2022

Guazzo, A., Trescato, I., Longato, E., Hazizaj, E., Dosso, D., Faggioli, G., Di Nunzio, G. M., Silvello, G., Vettoretti, M., Tavazzi, E., Roversi, C., Fariselli, P., Madeira, S. C., de Carvalho, M., Gromicho, M., Chi&actute&, A., Manera, U., Dagliati, A., Birolo, G., Aidos, H., Di Camillo, B., and Ferro, N. (2022)
Int. Conference Paper In Barrón-Cedeño, A., Da San Martino, G., Degli Esposti, M., Sebastiani, F., Macdonald, C., Pasi, G., Hanbury, A., Potthast, M., Faggioli, G., and Ferro, N., editors Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Thirteenth International Conference of the CLEF Association (CLEF 2022), pages 395-422. Lecture Notes in Computer Science (LNCS) 13390, Springer, Heidelberg, Germany

Evaluating the Integration of Datasets

Paganelli, M., Del Buono, F., Guerra, F., and Ferro, N. (2022)
Int. Conference Paper In Hong, J., Bures, M., Park, J. W., and Cerny, T., editors, Proc. 37th ACM/SIGAPP Symposium On Applied Computing (SAC 2022), pages 347-356. ACM Press, New York, USA

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2022)

Barrón-Cedeño, A., Da San Martino, G., Degli Esposti, M., Sebastiani, F., Macdonald, C., Pasi, G., Hanbury, A., Potthast, M., Faggioli, G., and Ferro, N., editors (2022).
Editorship Lecture Notes in Computer Science (LNCS) 13390, Springer, Heidelberg, Germany

CLEF 2022 Working Notes

Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors (2022)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

Proc. 26th International Conference on Theory and Practice of Digital Libraries (TPDL 2022)

Silvello, G., Corcho, O., Manghi, P., Di Nunzio, G. M., Golub, K., Ferro, N., and Poggi, A., editors (2022).
Editorship Lecture Notes in Computer Science (LNCS) 13541, Springer, Heidelberg, Germany

Extracting a Unified Database from Heterogeneous Bills of Materials via Data Integration Approaches

De Lucia, L., Faggioli, G., Ferro, N., and Orobelli, F. (2022)
Nat. Conference Paper In Amato, G., Bartalesi, V., Bianchini, D., Gennaro, C., and Torlone, R., editors Proc. 30th Italian Symposium on Advanced Database Systems (SEBD 2022), pages 13--24. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3194, ISSN 1613-0073.

Improving Conversational Evaluation via a Dependency-Aware Permutation Strategy

Faggioli, G., Ferrante, M., Ferro, N., Perego, R., and Tonellotto, N. (2022)
Nat. Conference Paper In Amato, G., Bartalesi, V., Bianchini, D., Gennaro, C., and Torlone, R., editors Proc. 30th Italian Symposium on Advanced Database Systems (SEBD 2022), pages 375-382. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3194, ISSN 1613-0073.

Comparing ANOVA Approaches to Detect Significantly Different IR Systems

Faggioli, G. and Ferro, N. (2022)
Nat. Conference Paper In Pasi, G., Cremonesi, P., Orlando, S., Zanker, M., Massimo, D., and Turati, G., editors Proc. 12th Italian Information Retrieval Workshop (IIR 2022). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3177, ISSN 1613-0073.

Feature Selection via Quantum Annealers for Ranking and Classification Tasks

Ferrari Dacrema, M., Moroni, F., Nembrini, R., Ferro, N., Faggioli, G., and Cremonesi, P. (2022)
Nat. Conference Paper In Pasi, G., Cremonesi, P., Orlando, S., Zanker, M., Massimo, D., and Turati, G., editors Proc. 12th Italian Information Retrieval Workshop (IIR 2022). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3177, ISSN 1613-0073.

Aldo Nadi at Touché 2022: Argument Retrieval for Comparative Questions

Aba, M., Azra, M., Gallo, M., Mohammad, O., Piacere, I., Virginio, G., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 2904-2918. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

SEUPD@CLEF: Team INTSEG on Argument Retrieval for Controversial Questions

Bahrami, S., Goli, G. P., Pasin, A., Rajkumari, N., Sohail, M. M., Tahan, P., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 2919-2932. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

SEUPD@CLEF: Team Lgtm on Argument Retrieval for Controversial Questions

Barusco, M., Del Fiume, G., Forzan, R., Peloso, M. G., Rizzetto, N., Soleymani, E., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 2933-2955. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

SEUPD@CLEF: Team Gamora on Argument Retrieval for Controversial Questions

Benetti, A., De Togni, M., Foti, G., Lacini, R., Matteazzi, A., Sgarbossa, E., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 2956-2968. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

SEUPD@CLEF: Team 6musk on Argument Retrieval for Controversial Questions by Using Pairs Selection and Query Expansion

Cappellotto, L., Lando, M., Lupu, D., Mariotto, M., Rosalen, R., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 3018-3031. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

SEUPD@CLEF: Team hextech on Argument Retrieval for Comparative Questions. The importance of adjectives in documents quality evaluation

Chimetto, A., Peressoni, D., Sabbatini, E., Tommasin, G., Varotto, M., Zanardelli, A., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 3041-3054. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

Overview of iDPP@CLEF 2022: The Intelligent Disease Progression Prediction Challenge

Guazzo, A., Trescato, I., Longato, E., Hazizaj, E., Dosso, D., Faggioli, G., Di Nunzio, G. M., Silvello, G., Vettoretti, M., Tavazzi, E., Roversi, C., Fariselli, P., Madeira, S. C., de Carvalho, M., Gromicho, M., Chiò, A., Manera, U., Dagliati, A., Birolo, G., Aidos, H., Di Camillo, B., and Ferro, N. (2022)
Int. Workshop Paper In Faggioli, G., Ferro, N., Hanbury, A., and Potthast, M., editors, CLEF 2022 Working Notes, pages 1130-1210. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 3180, ISSN 1613-0073

Overview of the NTCIR-16 We Want Web with CENTRE (WWW-4) Task

Sakai, T., Tao, S., Chu, Z., Maistro, M., Li, Y., Chen, N., Ferro, N., Wang, J., Soboroff, I., and Liu, Y. (2022).
Int. Workshop Paper In Kato, M. P., Yamamoto, T., and Dou, Z., editors, Proc. 16th NTCIR Conference on Evaluation of Information Access Technologies (NTCIR-16), pages 231-242. National Institute of Informatics, Tokyo, Japan

Towards Meaningful Statements in IR Evaluation. Mapping Evaluation Measures to Interval Scales

Ferrante, M., Ferro, N., and Fuhr, N. (2021)
Int. Journal Paper IEEE Access, 9: 136182-136216

Report on CLEF 2021: Experimental IR Meets Multilinguality, Multimodality, and Interaction

Candan, K. S., Faggioli, G., Ferro, N., Goeuriot, L., Ionescu, B., Joly, A., Larsen, B., Maistro, M., Müller, H., and Piroi, F. (2021).
Journal w/o Peer Review Paper SIGIR Forum, 55(2):1-12

repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments

Breuer, T., Ferro, N., Maistro, M., and Schaer, P. (2021)
Int. Conference Paper In Hiemstra, D., Moens, M.-F., Mothe, J., Perego, R., Potthast, M., and Sebastiani, F., editors, Advances in Information Retrieval. Proc. 43rd European Conference on IR Research (ECIR 2021) - Part II, pages 481-486. Lecture Notes in Computer Science (LNCS) 12657, Springer, Heidelberg, Germany

Hierarchical Dependence-aware Evaluation Measures for Conversational Search

Faggioli, G., Ferrante, M., Ferro, N., Perego, R., and Tonellotto, N. (2021)
Int. Conference Paper In Diaz, F., Shah, C., Suel, T., Castells, P., Jones, R., Sakai, T., Bellogín, A., and Yoshioka, M., editors, Proc. 44th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2021), pages 1935-1939. ACM Press, New York, USA

System Effect Estimation by Sharding: A Comparison between ANOVA Approaches to Detect Significant Differences

Faggioli, G. and Ferro, N. (2021)
Int. Conference Paper In Hiemstra, D., Moens, M.-F., Mothe, J., Perego, R., Potthast, M., and Sebastiani, F., editors, Advances in Information Retrieval. Proc. 43rd European Conference on IR Research (ECIR 2021) - Part II, pages 33-46. Lecture Notes in Computer Science (LNCS) 12657, Springer, Heidelberg, Germany

An Enhanced Evaluation Framework for Query Performance Prediction

Faggioli, G., Zendel, O., Culpepper, J. S., Ferro, N., and Scholer, F. (2021)
Int. Conference PaperBest Paper Award In Hiemstra, D., Moens, M.-F., Mothe, J., Perego, R., Potthast, M., and Sebastiani, F., editors, Advances in Information Retrieval. Proc. 43rd European Conference on IR Research (ECIR 2021) - Part I, pages 115-129. Lecture Notes in Computer Science (LNCS) 12656, Springer, Heidelberg, Germany

Proc. 11th Italian Information Retrieval Workshop (IIR 2021)

Anelli, V. W., Di Noia, T., Ferro, N., and Narducci, F., editors (2021)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2947, ISSN 1613-0073

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021)

Candan, K. S., Ionescu, B., Goeuriot, L., Larsen, B., Müller, H., Joly, A., Maistro, M., Piroi, F., Faggioli, G., and Ferro, N., editors (2021).
Editorship Lecture Notes in Computer Science (LNCS) 12880, Springer, Heidelberg, Germany

CLEF 2021 Working Notes

Faggioli, G., Ferro, N., Joly, A., Maistro, M., and Piroi, F., editors (2021)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2936, ISSN 1613-0073

NoBis: A Crowd Monitoring Service against COVID-19

Avanzi, M., Coniglio, R., Cisotto, G., Giordani, M., and Ferro, N. (2021)
Nat. Conference Paper In Dosso, D., Ferilli, S., Manghi, P., Poggi, A., Serra, G., and Silvello, G., editors, Proc. 17th Italian Research Conference on Digital Libraries (IRCDL 2021), pages 126-137. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol. 2816.

A Data Management and Anomaly Detection Solution for the Entertainment Industry

Berno, M., Canil, M., Chiarello, N., Piazzon, L., Berti, F., Ferrari, F., Zaupa, A., Ferro, N., Rossi, M., and Susto, G. A. (2021)
Nat. Conference Paper In Greco, S., Lenzerini, M., Masciari, E., and Tagarelli, A., editors, Proc. 29th Italian Symposium on Advanced Database Systems (SEBD 2021), pages 522–530. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol. 2994.

FullBrain: a Social E-learning Platform

Biasini, M., Carmignani, V., Ferro, N., Filianos, P., Maistro, M., and Di Nunzio, G. M. (2021)
Nat. Conference Paper In Dosso, D., Ferilli, S., Manghi, P., Poggi, A., Serra, G., and Silvello, G., editors, Proc. 17th Italian Research Conference on Digital Libraries (IRCDL 2021), pages 25-41. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol. 2816.

Do Hard Topics Exist? A Statistical Analysis

Culpepper, J. S., Faggioli, G., Ferro, N., and Kurland, O. (2021)
Nat. Conference Paper In Anelli, V. W., Di Noia, T., Ferro, N., and Narducci, F., editors, Proc. 11th Italian Information Retrieval Workshop (IIR 2021). CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol 2947.

sMARE: An Enhanced Query Performance Prediction Evaluation Approach

Faggioli, G., Zendel, O., Culpepper, J. S., Ferro, N., and Scholer, F. (2021)
Nat. Conference Paper In Greco, S., Lenzerini, M., Masciari, E., and Tagarelli, A., editors, Proc. 28th Italian Symposium on Advanced Database Systems (SEBD 2021), pages 235-242. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol. 2994.

s-AWARE: using crowd judgements in supervised measure-based methods for IR evaluation

Ferrante, M., Ferro, N., and Piazzon, L. (2021)
Nat. Conference Paper In Dosso, D., Ferilli, S., Manghi, P., Poggi, A., Serra, G., and Silvello, G., editors, Proc. 17th Italian Research Conference on Digital Libraries (IRCDL 2021), pages 162-168. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol. 2816.

A Machine Learning-based Approach for Advanced Monitoring of Automated Equipment for the Entertainment Industry

Berno, M., Canil, M., Chiarello, N., Piazzon, L., Berti, F., Ferrari, F., Zaupa, A., Ferro, N., Rossi, M., and Susto, G. A. (2021)
Int. Workshop Paper In Schena, E., Oddo, C., Sardini, E., and Daponte, P., editors, Proc. 2021 IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT), pages 386-391. IEEE Computer Society, Los Alamitos, CA, USA

How do interval scales help us with better understanding IR evaluation measures?

Ferrante, M., Ferro, N., and Losiouk, E. (2020)
Int. Journal Paper Information Retrieval Journal, 23(3):289-317.

Boosting Learning to Rank with User Dynamics and Continuation Methods

Ferro, N., Lucchese, C., Maistro, M., and Perego, R. (2020)
Int. Journal Paper Information Retrieval Journal, 23(6):528-554.

Report on CLEF 2020

Arampatzis, A., Cappellato, L., Eickhoff, C., Ferro, N., Joho, H., Kanoulas, E., Lioma, C., Névéol, A., Tsikrika, T., and Vrochidis, S. (2020).
Journal w/o Peer Review Paper SIGIR Forum, 54(2):11:1-11:10

How to Measure the Reproducibility of System-oriented IR Experiments

Breuer, T., Ferro, N., Fuhr, N., Maistro, M., Sakai, T., Schaer, P., and Soboroff, I. (2020)
Int. Conference Paper In Chang, Y., Cheng, X., Huang, J., Lu, Y., Kamps, J., Mur- dock, V., Wen, J.-R., Diriye, A., Guo, J., and Kurland, O, editors, Proc. 43rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020), pages 349-358. ACM Press, New York, USA

Exploiting Stopping Time to Evaluate Accumulated Relevance

Ferrante, M. and Ferro, N. (2020).
Int. Conference PaperBest Paper Award Balog, K., Setty, V., Lioma, C., Liu, Y., Zhang, M., and Berberich, K. editors, Proc. 6th ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR 2020), pages 169-176. ACM Press, New York, USA

s-AWARE: supervised measure-based methods for crowd-assessors combination

Ferrante, M., Ferro, N., and Piazzon, L. (2020).
Int. Conference Paper Arampatzis, A., Kanoulas, E., Tsikrika, T., Vrochidis, S., Joho, H., Lioma, C., Eickhoff, K., Névéol, A., Cappellato, L., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Eleventh International Conference of the CLEF Association (CLEF 2020), pages 16-27. Lecture Notes in Computer Science (LNCS) 12260, Springer, Heidelberg, Germany.

Unsupervised Evaluation of Data Integration Processes

Paganelli, M., Del Buono, F., Guerra, F., and Ferro, N. (2020).
Int. Conference Paper Indrawan-Santiago, M., Pardede, E., Salvadori, I. L., Steinbauer, M., Khalil, I., and Kotsis, G., editors, Proc. 22nd International Conference on Information Integration and Web-based Applications & Services (iiWAS 2020), pages 77-81. ACM Press, New York, USA.

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Eleventh International Conference of the CLEF Association (CLEF 2020)

Arampatzis, A., Kanoulas, E., Tsikrika, T., Vrochidis, S., Joho, H., Lioma, C., Eickhoff, K., Névéol, A., Cappellato, L., and Ferro, N., (2020).
Editorship Lecture Notes in Computer Science (LNCS) 12260, Springer, Heidelberg, Germany

CLEF 2020 Working Notes

Cappellato, L., Eickhoff, K., Ferro, N. and Névéol, A., editors (2020)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2696, ISSN 1613-0073

Advances in Information Retrieval. Proc. 42nd European Conference on IR Research (ECIR 2020) - Part I

Jose, J. M., Yilmaz, E., Magalhães, J., Castells, P., Ferro, N., Silva, M. J., and Martins, F., editors (2020).
Editorship Lecture Notes in Computer Science (LNCS) 12035, Springer, Heidelberg, Germany

Advances in Information Retrieval. Proc. 42nd European Conference on IR Research (ECIR 2020) - Part II

Jose, J. M., Yilmaz, E., Magalhães, J., Castells, P., Ferro, N., Silva, M. J., and Martins, F., editors (2020).
Editorship Lecture Notes in Computer Science (LNCS) 12036, Springer, Heidelberg, Germany

Improving Learning to Rank By Leveraging User Dynamics and Continuation Methods

Ferro, N., Lucchese, C., Maistro, M., and Perego, R. (2020)
Nat. Conference Paper In Agosti, M., Atzori, M., Ciaccia, P., and Tanca, L., editors, Proc. 28th Italian Symposium on Advanced Database Systems (SEBD 2020), pages 210-217. CEUR Workshop Proceedings (CEUR-WS.org), ISSN 1613-0073, Vol. 2646.

Reproducibility of the Neural Vector Space Model via Docker

Ferro, N., Marchesin, S., Purpura, A., and Silvello, G. (2020)
Nat. Conference Paper In Ceci, M., Ferilli, S., and Poggi, A., editors, Proc. 16th Italian Research Conference on Digital Libraries (IRCDL 2020), pages 3-8. Communications in Computer and Information Science (CCIS) 1177, Springer, Heidelberg, Germany

Overview of the NTCIR-15 We Want Web with CENTRE (WWW-3) Task

Sakai, T., Tao, S., Zeng, Z., Zheng, Y., Mao, J., Chu, Z., Liu, Y., Maistro, M., Dou, Z., Ferro, N., and Soboroff, I. (2020).
Int. Workshop Paper In Kando, N., Kato, M. P., and Liu, Y., editors, Proc. 15th NTCIR Conference on Evaluation of Information Access Technologies (NTCIR-15). National Institute of Informatics, Tokyo, Japan

A General Theory of IR Evaluation Measures

Ferrante, M., Ferro, N., and Pontarollo, S. (2019)
Int. Journal Paper IEEE Transactions on Knowledge and Data Engineering (TKDE), 31(3):409–422.

Using Collection Shards to Study Retrieval Performance Effect Sizes

Ferro, N., Kim, Y., and Sanderson, M. (2019)
Int. Journal Paper ACM Transactions on Information Systems (TOIS), 37(3):30:1-30:40

Report on ESSIR 2019: the 12th European Summer School in Information Retrieval

Agosti, M., Ferro, N., Pasi, G., and Viviani, M. (2019).
Journal w/o Peer Review Paper SIGIR Forum, 53(2):54-61

Report on CLEF 2019

Braschler, M., Cappellato, L., Crestani, F., Ferro, N., Heinatz Bürki, G., Losada, D. E., Müller, H., Rauber, A., and Savoy, J. (2019).
Journal w/o Peer Review Paper SIGIR Forum, 53(2):108-118

The SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019)

Clancy, R., Ferro, N., Hauff, C., Lin, J., Sakai, T., and Zhong Wu, Z. (2019)
Int. Conference Paper In Piwowarski, B., Chevalier, M., Gaussier, E., Maarek, Y., Nie, J.-Y., and Scholer, F., editors, Proc. 42nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019), pages 1432-1434. ACM Press, New York, USA

A Markovian Approach to Evaluate Session-based IR Systems

van Dijk, D., Ferrante, M., Ferro, N., and Kanoulas, E. (2019)
Int. Conference Paper In Azzopardi, L., Stein, B., Fuhr, N., Mayr, P., Hauff, C., and Hiemstra, D., editors, Advances in Information Retrieval. Proc. 41st European Conference on IR Research (ECIR 2019) - Part I, pages 621-635. Lecture Notes in Computer Science (LNCS) 11437, Springer, Heidelberg, Germany

Stochastic Relevance for Crowdsourcing

Ferrante, M., Ferro, N., and Losiouk, E. (2019)
Int. Conference Paper In Azzopardi, L., Stein, B., Fuhr, N., Mayr, P., Hauff, C., and Hiemstra, D., editors, Advances in Information Retrieval. Proc. 41st European Conference on IR Research (ECIR 2019) - Part I, pages 755-762. Lecture Notes in Computer Science (LNCS) 11437, Springer, Heidelberg, Germany

What Happened in CLEF... For a While?

Ferro, N. (2019)
Int. Conference Paper In Crestani, F., Braschler, M., Savoy, J., Rauber, A., Müller, H., Losada, D. E., Heinatz, G., Cappellato, L., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Tenth International Conference of the CLEF Association (CLEF 2019), pages 3-45. Lecture Notes in Computer Science (LNCS) 11696, Springer, Heidelberg, Germany

CENTRE@CLEF 2019

Ferro, N., Fuhr, N., Maistro, M., Sakai, T., and Soboroff, I. (2019)
Int. Conference Paper In Azzopardi, L., Stein, B., Fuhr, N., Mayr, P., Hauff, C., and Hiemstra, D., editors, Advances in Information Retrieval. Proc. 41st European Conference on IR Research (ECIR 2019) - Part II, pages 283-290. Lecture Notes in Computer Science (LNCS) 11438, Springer, Heidelberg, Germany

Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm

Ferro, N., Fuhr, N., Maistro, M., Sakai, T., and Soboroff, I. (2019)
Int. Conference Paper In Crestani, F., Braschler, M., Savoy, J., Rauber, A., Müller, H., Losada, D. E., Heinatz, G., Cappellato, L., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Tenth International Conference of the CLEF Association (CLEF 2019), pages 287-300. Lecture Notes in Computer Science (LNCS) 11696, Springer, Heidelberg, Germany

Improving the Accuracy of System Performance Estimation by Using Shards

Ferro, N. and Sanderson, M. (2019)
Int. Conference Paper In Piwowarski, B., Chevalier, M., Gaussier, E., Maarek, Y., Nie, J.-Y., and Scholer, F., editors, Proc. 42nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019), pages 805-814. ACM Press, New York, USA

An Innovative Approach to Data Management and Curation of Experimental Data Generated through IR Test Collections

Agosti, M., Di Nunzio, G. M., Ferro, N., and Silvello, G. (2019)
Int. Book Chapter In Ferro, N. and Peters, C., editors, Information Retrieval Evaluation in a Changing World - Lessons Learned from 20 Years of CLEF, volume 41 of The Information Retrieval Series, pages 105-122. Springer International Publishing, Germany

From Multilingual to Multimodal: The Evolution of CLEF over Two Decades

Ferro, N. and Peters, C. (2019)
Int. Book Chapter In Ferro, N. and Peters, C., editors, Information Retrieval Evaluation in a Changing World - Lessons Learned from 20 Years of CLEF, volume 41 of The Information Retrieval Series, pages 3-44. Springer International Publishing, Germany

Visual Analytics and IR Experimental Evaluation

Ferro, N. and Santucci, G. (2019)
Int. Book Chapter In Ferro, N. and Peters, C., editors, Information Retrieval Evaluation in a Changing World - Lessons Learned from 20 Years of CLEF, volume 41 of The Information Retrieval Series, pages 565-582. Springer International Publishing, Germany

Information Retrieval Evaluation in a Changing World - Lessons Learned from 20 Years of CLEF

Ferro, N. and Peters, C., editors (2019)
Book Editorship volume 41 of The Information Retrieval Series. Springer International Publishing, Germany

CLEF 2019 Working Notes

Cappellato, L., Ferro, N., Losada, D. E., and Müller, H., editors (2019)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2380, ISSN 1613-0073

Proc. of the Open-Source IR Replicability Challenge (OSIRRC 2019)

Clancy, R., Ferro, N., Hauff, C., Sakai, T., and Wu, Z. Z., editors (2019)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2409, ISSN 1613-0073

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Tenth International Conference of the CLEF Association (CLEF 2019)

Crestani, F., Braschler, M., Savoy, J., Rauber, A., Müller, H., Losada, D. E., Heinatz, G., Cappellato, L., and Ferro, N., editors (2019).
Editorship Lecture Notes in Computer Science (LNCS) 11696, Springer, Heidelberg, Germany

Proc. 9th International Workshop on Evaluating Information Access (EVIA 2019)

Ferro, N., Ishita, E., Kando, N., Kato, M. P., Soboroff, I., and Zhang, M., editors (2019)
Editorship National Institute of Informatics, Tokyo, Japan

Scales of Evaluation Measures: From Theory to Experimentation

Ferrante, M., Ferro, N., Losiouk, E., and Pontarollo, S. (2019)
Nat. Conference Paper In Agosti, M., Di Buccio, E., Melucci, M., Mizzaro, S., Pasi, G., and Silvestri, F., editors Proc. 10th Italian Information Retrieval Workshop (IIR 2019). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2441, ISSN 1613-0073

A formal theory to determine scale properties of evaluation measures

Ferrante, M., Ferro, N., and Pontarollo, S. (2019)
Nat. Conference Paper In Mecella, M., Amato, G. and Gennaro, C., editors, Proc. 27th Italian Symposium on Advanced Database Systems (SEBD 2019). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2400, ISSN 1613-0073

Overview of the 2019 Open-Source IR Replicability Challenge (OSIRRC 2019)

Clancy, R., Ferro, N., Hauff, C., Sakai, T., and Wu, Z. Z. (2019)
Int. Workshop Paper In Clancy, R., Ferro, N., Hauff, C., Sakai, T., and Wu, Z. Z, editors, Proc. of the Open-Source IR Replicability Challenge (OSIRRC 2019), pages 1-7. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2409, ISSN 1613-0073

CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks

Ferro, N., Fuhr, N., Maistro, M., Sakai, T., and Soboroff, I. (2019)
Int. Workshop Paper In Cappellato, L., Ferro, N., Losada, D. E., and Müller, H., editors, CLEF 2019 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2380, ISSN 1613-0073

A Docker-Based Replicability Study of a Neural Information Retrieval Model

Ferro, N., Marchesin, S., Purpura, A., and Silvello, G. (2019)
Int. Workshop Paper In Clancy, R., Ferro, N., Hauff, C., Sakai, T., and Wu, Z. Z., editors, Proc. of the Open-Source IR Replicability Challenge (OSIRRC 2019), pages 37-43. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2409, ISSN 1613-0073

Overview of the NTCIR-14 CENTRE Task

Sakai, T., Ferro, N., Soboroff, I., Zeng, Z., Xiao, P., and Maistro, M. (2019)
Int. Workshop Paper In Ishita, E., Kando, N., Kato, M. P., and Liu, Y., editors, Proc. 14th NTCIR Conference on Evaluation of Information Access Technologies (NTCIR-14), pages 494-509. National Institute of Informatics, Tokyo, Japan

Research Frontiers in Information Retrieval - Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018)

Allan, J., Arguello, J., Azzopardi, L., Bailey, P., Baldwin, T., Balog, K., Bast, H., Belkin, N., Berberich, K., von Billerbeck, B., Callan, J., Capra, R., Carman, M., Carterette, B., Clarke, C. L. A., Collins-Thompson, K., Craswell, N., Croft, W. B., Culpepper, J. S., Dalton, J., Demartini, G., Diaz, F., Dietz, L., Dumais, S., Eickhoff, C., Ferro, N., Fuhr, N., Geva, S., Hauff, C., Hawking, D., Joho, H., Jones, G. J. F., Kamps, J., Kando, N., Kelly, D., Kim, J., Kiseleva, J., Liu, Y., Lu, X., Mizzaro, S., Moffat, A., Nie, J.-Y., Olteanu, A., Ounis, I., Radlinski, F., de Rijke, M., Sanderson, M., Scholer, F., Sitbon, L., Smucker, M. D., Soboroff, I., Spina, D., Suel, T., Thom, J., Thomas, P., Trotman, A., Voorhees, E. M., de Vries, A. P., Yilmaz, E., and Zuccon, G. (2018).
Int. Journal Paper SIGIR Forum, 52(1):34-90

CLAIRE: A combinatorial visual analytics system for information retrieval evaluation

Angelini, M., Fazzini, V., Ferro, N., Santucci, G., and Silvello, G. (2018)
Int. Journal Paper Information Processing & Management, 54(6):1077-1100

Manifesto from Dagstuhl Perspectives Workshop 17442 - From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences

Ferro, N., Fuhr, N., Grefenstette, G., Konstan, J. A., Castells, P., Daly, E. M., Declerck, T., Ekstrand, M. D., Geyer, W., Gonzalo, J., Kuflik, T., Lindén, K., Magnini, B., Nie, J.-Y., Perego, R., Shapira, B., Soboroff, I., Tintarev, N., Verspoor, K., Willemsen, M. C., and Zobel, J. (2018).
Int. Journal Paper Dagstuhl Manifestos, Schloss Dagstuhl - Leibniz-Zentrum für Informatik, Germany, 7(1):96-139

Introduction to the Special Issue on Reproducibility in Information Retrieval: Evaluation Campaigns, Collections, and Analyses

Ferro, N., Fuhr, N., and Rauber, A. (2018)
Int. Journal Paper ACM Journal of Data and Information Quality (JDIQ), 10(3):9:1-9:4

Introduction to the Special Issue on Reproducibility in Information Retrieval: Tools and Infrastructures

Ferro, N., Fuhr, N., and Rauber, A. (2018)
Int. Journal Paper ACM Journal of Data and Information Quality (JDIQ), 10(4):14:1-14:4

Toward an Anatomy of IR System Component Performances

Ferro, N. and Silvello, G. (2018)
Int. Journal Paper Journal of the American Society for Information Science and Technology (JASIST), 69(2):187-200

Report on CLEF 2018: Experimental IR Meets Multilinguality, Multimodality, and Interaction

Bellot, P., Cappellato, L., Ferro, N., Mothe, J., Murtagh, F., Nie, J.-Y., SanJuan, E., Soulier, L., and Trabelsi, C. (2018)
Journal w/o Peer Review Paper SIGIR Forum, 52(2):72-82

Report from Dagstuhl Perspectives Workshop 17442 - Towards Performance Modeling and Performance Prediction across IR/RecSys/NLP

Ferro, N., Fuhr, N., Grefenstette, G., and Konstan, J. A. (2018)
Journal w/o Peer Review Paper Dagstuhl Reports, Schloss Dagstuhl - Leibniz-Zentrum für Informatik, Germany, 7(10):139-146

The Dagstuhl Perspectives Workshop on Performance Modeling and Prediction

Ferro, N., Fuhr, N., Grefenstette, G., Konstan, J. A., Castells, P., Daly, E. M., Declerck, T., Ekstrand, M. D., Geyer, W., Gonzalo, J., Kuflik, T., Lindén, K., Magnini, B., Nie, J.-Y., Perego, R., Shapira, B., Soboroff, I., Tintarev, N., Verspoor, K., Willemsen, M. C., and Zobel, J. (2018)
Journal w/o Peer Review Paper SIGIR Forum, 52(1):91-101

SIGIR Initiative to Implement ACM Artifact Review and Badging

Ferro, N. and Kelly, D. (2018)
Journal w/o Peer Review Paper SIGIR Forum, 52(1):4-10

Report on EVIA 2017: 8th International Workshop on Evaluating Information Access

Ferro, N. and Soboroff, I. (2018)
Journal w/o Peer Review Paper SIGIR Forum, 52(1):162-166

Report on GLARE 2018: 1st Workshop on Generalization in Information Retrieval: Can We Predict Performance in New Domains?

Soboroff, I., Ferro, N., and Fuhr, N. (2018)
Journal w/o Peer Review Paper SIGIR Forum, 52(2):132-137

Modelling Randomness in Relevance Judgments and Evaluation Measures

Ferrante, M., Ferro, N., and Pontarollo, S. (2018)
Int. Conference Paper In Pasi, G., Piwowarski, B., Azzopardi, L., and Hanbury, A., editors, Advances in Information Retrieval. Proc. 40th European Conference on IR Research (ECIR 2018), pages 197-209. Lecture Notes in Computer Science (LNCS) 10772, Springer, Heidelberg, Germany

Continuation Methods and Curriculum Learning for Learning to Rank

Ferro, N., Lucchese, C., Maistro, M., and Perego, R. (2018)
Int. Conference Paper Cuzzocrea, A., Allan, J., Paton, N. W., Srivastava, D., Agrawal, R., Broder, A., Zaki, M. J., Candan, S., Labrinidis, A., Schuster, A., and Wang, H. editors, Proc. 27th International Conference on Information and Knowledge Management (CIKM 2018), pages 1523-1526. ACM Press, New York, USA

Overview of CENTRE@CLEF 2018: a First Tale in the Systematic Reproducibility Realm

Ferro, N., Maistro, M., Sakai, T., and Soboroff, I. (2018)
Int. Conference Paper In Bellot, P., Trabelsi, C., Mothe, J., Murtagh, F., Nie, J.-Y., Soulier, L., SanJuan, E., Cappellato, L., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Ninth International Conference of the CLEF Association (CLEF 2018), pages 239-246. Lecture Notes in Computer Science (LNCS) 11018, Springer, Heidelberg, Germany

Evaluation of Conformance Checkers for Long-Term Preservation of Multimedia Documents

Ferro, N., Silvello, G., Buelinckx, E., Doubrov, B., Fresa, A., Geber, M., Jadeglans, K., Justrell, B., Lemmens, B., Martinez, J., Muñoz, V., Oliveras, S., Prandoni, C., Rice, D., Rohde-Enslin, S., Tarrés, X., Verbruggen, E., Yousefi, B., and Wilson, C. (2018)
Int. Conference Paper Chen, J., Gonçalves, M. A., Allen, J. M., Fox, E. A., Kan, M.-Y., and Petras, V., editors, Proc. 18th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2018), pages 145-154. ACM Press, New York, USA

Overview of the TREC 2018 CENTRE Track

Soboroff, I., Ferro, N., Maistro, M., and Sakai, T. (2019)
Int. Conference Paper In Voorhees, E. M. and Ellis, A., editors, The Twenty-Seventh Text REtrieval Conference Proceedings (TREC 2018). National Institute of Standards and Technology (NIST), Special Publication 500-331, Washington, USA

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Ninth International Conference of the CLEF Association (CLEF 2018)

Bellot, P., Trabelsi, C., Mothe, J., Murtagh, F., Nie, J.-Y., Soulier, L., SanJuan, E., Cappellato, L., and Ferro, N., editors (2018)
Editorship Lecture Notes in Computer Science (LNCS) 11018, Springer, Heidelberg, Germany

CLEF 2018 Working Notes

Cappellato, L., Ferro, N., Nie, J.-Y., and Soulier, L., editors (2018)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2125, ISSN 1613-0073
Issue 10:3 Issue 10:4

Special Issue on Reproducibility in Information Retrieval

Ferro, N., Fuhr, N., and Rauber, A., editors (2018)
Editorship ACM Journal of Data and Information Quality (JDIQ), 10:3 and 10:4

Digital Libraries: From Digital Resources to Challenges in Scientific Data Sharing and Re-Use

Agosti, M., Ferro, N., and Silvello, G. (2018)
Int. Book Chapter In Flesca, S., Greco, S., Masciari, E., and Saccà, D., editors, Comprehensive Guide Through the Italian Database Research Over the Last 25 Years, volume 31 of Studies in Big Data, pages 27-41. Springer International Publishing, Germany

CENTRE@CLEF2018: Overview of the Replicability Task

Ferro, N., Maistro, M., Sakai, T., and Soboroff, I. (2018)
Int. Workshop Paper In Cappellato, L., Ferro, N., Nie, J.-Y., and Soulier, L., editors, CLEF 2018 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2125, ISSN 1613-0073

Thirty Years of Digital Libraries Research at the University of Padua: The User Side

Agosti, M., Di Nunzio, G. M., Ferro, N., Maistro, M., Marchesin, S., Orio, N., Ponchia, C., and Silvello, G. (2018)
Nat. Conference Paper In Serra, G. and Tasso, C., editors, Proc. 14th Italian Research Conference on Digital Libraries (IRCDL 2018), pages 42-54. Communications in Computer and Information Science (CCIS) 806, Springer, Heidelberg, Germany

Thirty Years of Digital Libraries Research at the University of Padua: The Systems Side

Agosti, M., Di Nunzio, G.M., Ferro, N., and Silvello, G. (2018)
Nat. Conference Paper In Serra, G. and Tasso, C., editors, Proc. 14th Italian Research Conference on Digital Libraries (IRCDL 2018), pages 30-41. Communications in Computer and Information Science (CCIS) 806, Springer, Heidelberg, Germany

The CLAIRE Visual Analytics System for Analysing IR Evaluation Data

Angelini, M., Fazzini, V., Ferro, N., Santucci, G., and Silvello, G. (2018)
Nat. Conference Paper In Tonellotto, N., Becchetti, L., and Tkalčič, M., editors, Proc. 9th Italian Information Retrieval Workshop (IIR 2018). CEUR Workshop Proceedings (CEUR-WS.org), VOl. 2140, ISSN 1613-0073

How to Robustly Combine Judgements from Crowd Assessors with AWARE

Ferrante, M., Ferro, N., and Maistro, M. (2018)
Nat. Conference Paper In Bergamaschi, S., Di Noia, T., and Maurino, A., editors, Proc. 26th Italian Symposium on Advanced Database Systems (SEBD 2018). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2161, ISSN 1613-0073

How Topic and System Size Affect the Correlation among Evaluation Measures

Ferro, N. (2018)
Nat. Conference Paper In Tonellotto, N., Becchetti, L., and Tkalčič, M., editors, Proc. 9th Italian Information Retrieval Workshop (IIR 2018). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2140, ISSN 1613-0073

Graph Databases Benchmarking on the Italian Business Register

Ferro, N. and Sinico, L. (2018)
Nat. Conference Paper In Bergamaschi, S., Di Noia, T., and Maurino, A., editors, Proc. 26th Italian Symposium on Advanced Database Systems (SEBD 2018). CEUR Workshop Proceedings (CEUR-WS.org), , Vol. 2161, ISSN 1613-0073

Overview of Special Issue - ACM SIGIR Test of Time Awardees, 1978-2001

Allan, J., Belkin, N. J., Bennett, P. N., Callan, J., Clarke, C. L. A., Diaz, F., Dumais, S., Ferro, N., Harman, D.K., Hiemstra, D., Ruthven, I., Sakai, T., Smucker, M.D., and Zobel, J. (2017)
Int. Journal Paper In Harman, D. K. and Kelly, D., editors, SIGIR Forum, 51(2):1-25

AWARE: Exploiting Evaluation Measures to Combine Multiple Assessors

Ferrante, M. Ferro, N., and Maistro, M. (2017)
Int. Journal Paper ACM Transactions on Information Systems (TOIS), 36(2):20:1-20:38

What Does Affect the Correlation Among Evaluation Measures?

Ferro, N. (2017)
Int. Journal Paper ACM Transactions on Information Systems (TOIS), 36(2):19:1-19:40

Reproducibility Challenges in Information Retrieval Evaluation

Ferro, N. (2017)
Int. Journal Paper ACM Journal of Data and Information Quality (JDIQ), 8(2):8:1-8:4

3.5K runs, 5K topics, 3M assessments and 70M measures: What trends in 10 years of Adhoc-ish CLEF?

Ferro, N. and Silvello, G. (2017)
Int. Journal Paper Information Processing & Management, 53(1):175-202

A surveillance system of diseases of companion animals in Veneto region (Italy)

Martini, M., Fenati, M., Agosti, M., Cassini, R., Drigo, M., Ferro, N., Guglielmini, C., Masiero, I., Signorini, M., and Busetto, R. (2017)
Int. Journal Paper Scientific and Technical Review of the OIE, 36(3):1007-1014

Semantic Representation and Enrichment of Information Retrieval Experimental Data

Silvello, G., Bordea, G., Ferro, N., Buitelaar, P., and Bogers, T. (2017)
Int. Journal Paper International Journal on Digital Libraries (IJDL), 18(2):145-172

Report on CLEF 2017: Experimental IR Meets Multilinguality, Multimodality, and Interaction

Cappellato, L., Ferro, N., Goeuriot, L., Gonzalo, J., Jones, G. J. F., Kelly, L., Lawless, S., and Mandl, T. (2017)
Journal w/o Peer Review Paper SIGIR Forum, 51(3):67-77

Report on LEARNER 2017: 1st International Workshop on LEARning Next gEneration Rankers

Ferro, N., Lucchese, C., Maistro, M., and Perego, R. (2017)
Journal w/o Peer Review Paper SIGIR Forum, 51(3):145-151

Are IR Evaluation Measures on an Interval Scale?

Ferrante, M., Ferro, N., and Pontarollo, S. (2017)
Int. Conference PaperBest Paper Award In Kamps, J., Kanoulas, E., de Rijke, M., Fang, H., and Yilmaz, E., editors, Proc. 3rd ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR 2017), pages 67-74. ACM Press, New York, USA

IMS @ TREC 2017 Core Track

Ferro, N. (2018)
Int. Conference Paper In Voorhees, E. M. and Ellis, A., editors, The Twenty-Sixth Text REtrieval Conference Proceedings (TREC 2017). National Institute of Standards and Technology (NIST), Special Publication 500-324, Washington, USA

On Including the User Dynamic in Learning to Rank

Ferro, N., Lucchese, C., Maistro, M., and Perego, R. (2017)
Int. Conference Paper In Kando, N., Sakai, T., Joho, H., Li, H., de Vries, A. P., and White, R. W., editors, Proc. 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017), pages 1041-1044. ACM Press, New York, USA

LEARning Next gEneration Rankers (LEARNER 2017)

Ferro, N., Lucchese, C., Maistro, M., and Perego, R. (2017)
Int. Conference Paper In Kamps, J., Kanoulas, E., de Rijke, M., Fang, H., and Yilmaz, E., editors, Proc. 3rd ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR 2017), pages 331-332. ACM Press, New York, USA

Sub-corpora Impact on System Effectiveness

Ferro, N. and Sanderson, M. (2017)
Int. Conference Paper In Kando, N., Sakai, T., Joho, H., Li, H., de Vries, A. P., and White, R. W., editors, Proc. 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017), pages 901-904. ACM Press, New York, USA

CLEF 2017 Working Notes

Cappellato, L., Ferro, N., Goeuriot, L., and Mandl, T., editors (2017)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1866, ISSN 1613-0073

Proc. 1st International Workshop on LEARning Next gEneration Rankers (LEARNER 2017)

Ferro, N., Lucchese, C., Maistro, M., and Perego, R., editors (2017)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2007, ISSN 1613-0073

Proc. 8th International Workshop on Evaluating Information Access (EVIA 2017)

Ferro, N. and Soboroff, I., editors (2017)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2008, ISSN 1613-0073

Proc. 1st International Workshop on Keyword-Based Access and Ranking at Scale (KARS 2017) - Proc. of the Workshops of the EDBT/ICDT 2017 Joint Conference (EDBT/ICDT 2017)

Ioannidis, Y. E., Stoyanovich, J., Orsi, G., Song, I.-Y., Marcel, P., Martoglia, R., Penzo, W., Mandreoli, F., De Virgilio, R., De Antonellis, V., Bianchini, D., Kotzinos, D., Christophides, V., Nikolaou, C., Theodoridis, Y., Ferro, N., Guerra, F., Ives, Z., Silvello, G., and Theobald, M., editors (2017)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1810, ISSN 1613-0073

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Eighth International Conference of the CLEF Association (CLEF 2017)

Jones, G. J. F., Lawless, S., Gonzalo, J., Kelly, L., Goeuriot, L., Mandl, T., Cappellato, L., and Ferro, N., editors (2017)
Editorship Lecture Notes in Computer Science (LNCS) 10456, Springer, Heidelberg, Germany

Visual Analytics for Information Retrieval Evaluation Campaigns

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2017)
Int. Workshop Paper In Sedlmair, M. and Tominski, C., editors, Proc. 8th International Workshop on Visual Analytics (EuroVA 2017), pages 25-29. Eurographics Association, Goslar, Germany

Towards open-source shared implementations of keyword-based access systems to relational data

Badan, A., Benvegnù, L., Biasetton, M., Bonato, G., Brighente, A., Cenzato, A., Ceron, P., Cogato, G., Marchesin, S., Minetto, A., Pellegrina, L., Purpura, A., Simionato, R., Soleti, N., Tessarotto, M., Tonon, A., Vendramin, F., and Ferro, N. (2017)
Int. Workshop Paper In Ioannidis, Y. E., Stoyanovich, J., Orsi, G., Song, I.-Y., Marcel, P., Martoglia, R., Penzo, W., Mandreoli, F., De Virgilio, R., De Antonellis, V., Bianchini, D., Kotzinos, D., Christophides, V., Nikolaou, C., Theodoridis, Y., Ferro, N., Guerra, F., Ives, Z., Silvello, G., and Theobald, M., editors, Proc. 1st International Workshop on Keyword-Based Access and Ranking at Scale (KARS 2017) - Proc. of the Workshops of the EDBT/ICDT 2017 Joint Conference (EDBT/ICDT 2017). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1810, ISSN 1613-0073

An Interval-Like Scale Property for IR Evaluation Measures

Ferrante, M., Ferro, N., and Pontarollo, S. (2017)
Int. Workshop Paper In Ferro, N. and Soboroff, I., editors, Proc. 8th International Workshop on Evaluating Information Access (EVIA 2017). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2008, ISSN 1613-0073

A Software Library for Conducting Large Scale Experiments on Learning to Rank Algorithms

Ferro, N., Picello, P., and Silvello, G. (2017)
Int. Workshop Paper In Ferro, N., Lucchese, C., Maistro, M., and Perego, R., editors, Proc. 1st International Workshop on LEARning Next gEneration Rankers (LEARNER 2017). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2007, ISSN 1613-0073

Keyword-based access to relational data: To reproduce, or to not reproduce?

Badan, A., Benvegnù, L., Biasetton, M., Bonato, G., Brighente, A., Marchesin, S., Minetto, A., Pellegrina, L., Purpura, A., Simionato, R., Tessarotto, M., Tonon, A., and Ferro, N. (2018)
Nat. Conference Paper In Flesca, S., Greco, S., Masciari, E., and Saccà, D., editors, Proc. 25th Italian Symposium on Advanced Database Systems (SEBD 2017). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 2037, ISSN 1613-0073

Component-Based Evaluation using GLMM

Ferro, N. and Silvello, G. (2017)
Nat. Conference Paper In Crestani, F., Di Noia, T., and Perego, R., editors, Proc. 8th Italian Information Retrieval Workshop (IIR 2017), pages 9-12. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1911, ISSN 1613-0073

The Road Towards Reproducibility in Science: The Case of Data Citation

Ferro, N. and Silvello, G. (2017)
Nat. Conference Paper In Grana, C. and Baraldi, L., editors, Proc. 13th Italian Research Conference on Digital Libraries (IRCDL 2017), pages 20-31. Communications in Computer and Information Science (CCIS) 733, Springer, Heidelberg, Germany

Digital Library Interoperability at High Level of Abstraction

Agosti, M., Ferro, N., and Silvello, G. (2016)
Int. Journal Paper Future Generation Computer Systems (FGCS), 55:129-146

Keyword-based Search over Databases: A Roadmap for a Reference Architecture Paired with an Evaluation Framework

Bergamaschi, S., Ferro, N., Guerra, F. and Silvello, G. (2016)
Int. Journal Paper LNCS Transactions on Computational Collective Intelligence (TCCI), 9630:1-20

Descendants, Ancestors, Children and Parent: A Set-Based Approach to Efficiently Address XPath Primitives

Ferro, N. and Silvello, G. (2016)
Int. Journal Paper Information Processing & Management, 52(3):399-429

The Twist Measure for IR Evaluation: Taking User's Effort Into Account

Ferro, N., Silvello, G., Keskustalo, H., Pirkola, A., and Järvelin, K. (2016)
Int. Journal Paper Journal of the American Society for Information Science and Technology (JASIST), 67(3):620-648

DIRECT and LOD-DIRECT

Ferro, N. (2016)
Journal w/o Peer Review Paper In Freire, J., Fuhr, N., and Rauber, A., editors, Report from Dagstuhl Seminar 16041: Reproducibility of Data-Oriented Experiments in e-Science, Dagstuhl Reports, Volume 6, Number 1, page 115. Schloss Dagstuhl--Leibniz-Zentrum für Informatik, Germany

Managing and Curating IR Experimental Data

Ferro, N. (2016)
Journal w/o Peer Review Paper In Freire, J., Fuhr, N., and Rauber, A., editors, Report from Dagstuhl Seminar 16041: Reproducibility of Data-Oriented Experiments in e-Science, Dagstuhl Reports, Volume 6, Number 1, pages 120-121. Schloss Dagstuhl--Leibniz-Zentrum für Informatik, Germany

Report on ECIR 2016: 38th European Conference on Information Retrieval

Ferro, N., Crestani, F., Moens, M.-F., Mothe, J., Silvestri, F., Kekäläinen, J., Rosso, P., Clough, P., Pasi, G., Lioma, C., Mizzaro, S., Di Nunzio, G. M., Hauff, C., Alonso, O., Serdyukov, P., and Silvello, G. (2016)
Journal w/o Peer Review Paper SIGIR Forum, 50(1):12-27

User Studies in IR

Ferro, N., Fuhr, N., Järvelin, K., Kando, N., and Lippold, M. (2016)
Journal w/o Peer Review Paper In Freire, J., Fuhr, N., and Rauber, A., editors, Report from Dagstuhl Seminar 16041: Reproducibility of Data-Oriented Experiments in e-Science, Dagstuhl Reports, Volume 6, Number 1, pages 152-157. Schloss Dagstuhl--Leibniz-Zentrum für Informatik, Germany

Increasing Reproducibility in IR: Findings from the Dagstuhl Seminar on "Reproducibility of Data-Oriented Experiments in e-Science"

Ferro, N., Fuhr, N., Järvelin, K., Kando, N., Lippold, M., and Zobel, J. (2016)
Journal w/o Peer Review Paper SIGIR Forum, 50(1):68-82.

PRIMAD - Information gained by different types of reproducibility

Rauber, A., Braganholo, V., Dittrich, J., Ferro, N., Freire, J., Fuhr, N., Garijo, D., Goble, C., Järvelin, K., Ludäscher, B., Stein, B., and Stotzka, R. (2016)
Journal w/o Peer Review Paper In Freire, J., Fuhr, N., and Rauber, A., editors, Report from Dagstuhl Seminar 16041: Reproducibility of Data-Oriented Experiments in e-Science, Dagstuhl Reports, Volume 6, Number 1, pages 128-132. Schloss Dagstuhl--Leibniz-Zentrum für Informatik, Germany

"Data Citation is Coming". Introduction to the Special Issue on Data Citation

Silvello, G. and Ferro, N. (2016)
Journal w/o Peer Review Paper Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 12(1):1-5.

A Visual Analytics Approach for What-If Analysis of Information Retrieval Systems

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2016)
Int. Conference Paper In Perego, R., Sebastiani, F., Aslam, J., Ruthven, I., and Zobel, J., editors, Proc. 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2016), pages 1081-1084. ACM Press, New York, USA

System And User Centered Evaluation Approaches in Interactive Information Retrieval (SAUCE 2016)

O'Brien, H., Ferro, N., Joho, H., Lewandowski, D., Thomas, P., and van Rijsbergen, C. J. (2016)
Int. Conference Paper In Kelly, D., Capra, R., Belkin, N., Teevan, J., and Vakkari, P., editors, Proc. 1st ACM on Conference on Human Information Interaction and Retrieval (CHIIR 2016), pages 337-340. ACM Press, New York, USA

A General Linear Mixed Models Approach to Study System Component Effects

Ferro, N. and Silvello, G. (2016)
Int. Conference Paper In Perego, R., Sebastiani, F., Aslam, J., Ruthven, I., and Zobel, J., editors, Proc. 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2016), pages 25-34. ACM Press, New York, USA

The CLEF Monolingual Grid of Points

Ferro, N. and Silvello, G. (2016)
Int. Conference Paper In Fuhr, N., Quaresma, P., Gonçalves, T., Larsen, B., Balog, K., Macdonald, C., Cappellato, L., and Ferro, N., editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Seventh International Conference of the CLEF Association (CLEF 2016), pages 16-27. Lecture Notes in Computer Science (LNCS) 9822, Springer, Heidelberg, Germany

CLEF 2016 Working Notes

Balog, K., Cappellato, L., Ferro, N., and Macdonald, C., editors (2016)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1609, ISSN 1613-0073

Advances in Information Retrieval. Proc. 38th European Conference on IR Research (ECIR 2016)

Ferro, N., Crestani, F., Moens, M.-F., Mothe, J., Silvestri, F., Di Nunzio, G. M., Hauff, C., and Silvello, G., editors (2016)
Editorship Lecture Notes in Computer Science (LNCS) 9626, Springer, Heidelberg, Germany

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Seventh International Conference of the CLEF Association (CLEF 2016)

Fuhr, N., Quaresma, P., Gonçalves, T., Larsen, B., Balog, K., Macdonald, C., Cappellato, L., and Ferro, N., editors (2016)
Editorship Lecture Notes in Computer Science (LNCS) 9822, Springer, Heidelberg, Germany

IEEE TCDL Special Issue on Data Citation

Silvello, G. and Ferro, N., editors (2016)
Editorship Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 12:1

From Users to Systems: Identifying and Overcoming Barriers to Efficiently Access Archival Data

Ferro, N. and Silvello, G. (2016)
Int. Workshop Paper In Clough, P., Goodale, P., Agosti, M., and Lawless, S., editors, Proc. First International Workshop on Accessing Cultural Heritage at Scale (ACHS 2016). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1611, ISSN 1613-0073

An Ontology to Make the DELOS Reference Model and the 5S Model Interoperable

Agosti, M., Ferro, N., and Silvello, G. (2017)
Nat. Conference Paper In Agosti, M., Bertini, M., Ferilli, S., Marinai, S., and Orio, N., editors, Proc. 12th Italian Research Conference on Digital Libraries (IRCDL 2016), pages 85-91. Communications in Computer and Information Science (CCIS) 701, Springer, Heidelberg, Germany

What-If Analysis: A Visual Analytics Approach to Information Retrieval Evaluation

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2016).
Nat. Conference Paper In Di Nunzio, G. M., Nardini, F. M., and Orlando, S. editors, Proc. 7th Italian Information Retrieval Workshop (IIR 2016). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1653, ISSN 1613-0073

IR Scientific Data: How to Semantically Represent and Enrich Them

Bogers, T., Bordea, G., Buitelaar, P., Ferro, N., and Silvello, G. (2016).
Nat. Conference Paper In Basile, P., Corazza, A., Cutugno, F., Montemagni, S., Nissim, M., Patti, V., Semeraro, G., and Sprugnoli, R., editors Proc. 3rd Italian Conference on Computational Linguistics (CLiC-it 2016) & 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1749, ISSN 1613-0073

Basis of a Formal Framework for Information Retrieval Evaluation Measurements

Ferrante, M., Ferro, N., and Maistro, M. (2016)
Nat. Conference Paper In Di Nunzio, G. M., Nardini, F. M., and Orlando, S. editors, Proc. 7th Italian Information Retrieval Workshop (IIR 2016). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1653, ISSN 1613-0073

Proposal for an Evaluation Framework for Compliance Checkers for Long-term Digital Preservation

Ferro, N. (2017)
Nat. Conference Paper In Agosti, M., Bertini, M., Ferilli, S., Marinai, S., and Orio, N., editors, Proc. 12th Italian Research Conference on Digital Libraries (IRCDL 2016), pages 125-136. Communications in Computer and Information Science (CCIS) 701, Springer, Heidelberg, Germany

Fast Access to XML Data: A Set-based Approach

Ferro, N. and Silvello, G. (2016)
Nat. Conference Paper In Bochicchio, M. A. and Mecca, G., editors, Proc. 24th Italian Symposium on Advanced Database Systems (SEBD 2016), pages 286-293. Edizioni Matematicamente.it, San Donato (LE), Italy.

Report on CLEF 2015: Experimental IR Meets Multilinguality, Multimodality, and Interaction

Cappellato, L., Ferro, N., Jones, G. J. F., Kamps, J., Mothe, J., Pinel-Sauvagnat, K., SanJuan, E., and Savoy, J. (2015)
Journal w/o Peer Review Paper SIGIR Forum, 49(2):47-56

1st International Workshop on Multilingual Web Access (MWA 2015)

Steichen, B., Ferro, N., Lewis, D., and Chi, E. H. (2015)
Journal w/o Peer Review Paper SIGIR Forum, 49(2):137-140

Visual Analytics for Information Retrieval Evaluation (VAIRË 2015)

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2015)
Int. Conference Paper In Fuhr, N., Rauber, A., Kazai, G., and Hanbury, A., editors, Advances in Information Retrieval. Proc. 37th European Conference on IR Research (ECIR 2015), pages 809-812. Lecture Notes in Computer Science (LNCS) 9022, Springer, Heidelberg, Germany

Towards a Formal Framework for Utility-oriented Measurements of Retrieval Effectiveness

Ferrante, M., Ferro, N., and Maistro, M. (2015)
Int. Conference Paper In Allan, J., Croft, W. B., de Vries, A. P., Zhai, C., Fuhr, N., and Zhang, Y., editors, Proc. 1st ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR 2015), pages 21-30. ACM Press, New York, USA

Rank-Biased Precision Reloaded: Reproducibility and Generalization

Ferro, N. and Silvello, G. (2015)
Int. Conference Paper In Fuhr, N., Rauber, A., Kazai, G., and Hanbury, A., editors, Advances in Information Retrieval. Proc. 37th European Conference on IR Research (ECIR 2015), pages 768-780. Lecture Notes in Computer Science (LNCS) 9022, Springer, Heidelberg, Germany

Targeted Query Expansions as a Method for Searching Mixed Quality Digitized Cultural Heritage Documents

Keskustalo, H., Kettunen, K., Kumpulainen, S., Ferro, N., Silvello, G., Järvelin, A., Kekäläinen, J., Arvola, P., Sormunen, E., Järvelin, K., and Saastamoinen, M. (2015)
Int. Conference Paper In Olson, G., Bailey, D., Reddy, M., Caswell, M., Sarcevic, A., Carroll, J. C., Olson, J., Farnham, S. D., Monroy-Hernandez, A., and Semaan, B., editors, Proc. iConference 2015

SVETPET: A Surveillance System of Diseases of Companion Animals in The Veneto Region (Italy)

Martini, M., Agosti, M., Berlanda, M., Candaten, M., Cassini, R., Dotto, G., Drigo, M., Fenati, M., Ferro, N., Finotti, L., Franzo, G., Guglielmini, C., Masiero, I., Mazzotta, E., Menandro, M. L., Pasotto, D., Pietrobelli, M., Signorini, M., Veladiano, I., and Busetto, R. (2015)
Int. Conference Paper In Fejzic, N., Ferizbegovic, J., Besirovic, H., and Grieco, V., editors, Proc. International Congress "One World - One Health - One Vision"

CLEF 2015 Working Notes

Cappellato, L., Ferro, N., Jones, G. J. F., and SanJuan, E., editors (2015)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1391, ISSN 1613-0073

1st AI*IA Workshop on Intelligent Techniques At LIbraries and Archives (IT@LIA 2015)

Ferilli, S. and Ferro, N., editors (2015)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1509, ISSN 1613-0073

Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Sixth International Conference of the CLEF Association (CLEF 2015)

Mothe, J., Savoy, J., Kamps, J., Pinel-Sauvagnat, K., Jones, G. J. F., SanJuan, E., Cappellato, L., and Ferro, N., editors (2015)
Editorship Lecture Notes in Computer Science (LNCS) 9283, Springer, Heidelberg, Germany

Proc. 1st International Workshop on Multilingual Web Access (MWA 2015)

Steichen, B., Ferro, N., Lewis, D., and Chi, E. H., editors (2015)
Editorship ACM Press, New York, USA

Unfolding Off-the-shelf IR Systems for Reproducibility

Di Buccio, E., Di Nunzio, G. M., Ferro, N., Harman, D. K., Maistro, M., and Silvello, G. (2015)
Int. Workshop Paper In Arguello, J., Diaz, F., Lin, J., and Trotman, A., editors, Proc. SIGIR Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR 2015)

A Perspective Look at Keyword-based Search Over Relation Data and its Evaluation

Bergamaschi, S., Ferro, N., Guerra, F., and Silvello, G. (2015)
Nat. Conference Paper In Atzeni, P., Lenzerini, M., Lembo, D., and Torlone, R., editors, Proc. 23rd Italian Symposium on Advanced Database Systems (SEBD 2015)

The PREFORMA Project: Federating Memory Institutions for Better Compliance of Preservation Formats

Cappellato, L., Ferro, N., Fresa, A., Geber, M., Justrel, B., Lemmen, B., Prandon, C., and Silvello, G. (2016)
Nat. Conference Paper In Calvanese, D., De Nart, D., and Tasso, C., editors, Digital Libraries on the Move - Proc. 11th Italian Research Conference on Digital Libraries (IRCDL 2015), pages 86-91. Communications in Computer and Information Science (CCIS) 612, Springer, Heidelberg, Germany

Markov Precision: Modelling User Behaviour over Rank and Time

Ferrante, M., Ferro, N., and Maistro, M. (2015)
Nat. Conference Paper In Boldi, P., Perego, R., and Sebastiani, F., editors, Proc. 6th Italian Information Retrieval Workshop (IIR 2015). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1404, ISSN 1613-0073

CLEF 2000 - 2014: Lessons Learnt from Ad Hoc Retrieval

Ferro, N. and Silvello, G. (2015)
Nat. Conference Paper In Boldi, P., Perego, R., and Sebastiani, F., editors, Proc. 6th Italian Information Retrieval Workshop (IIR 2015). CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1404, ISSN 1613-0073

Towards a Semantic Web Enabled Representation of DL Foundational Models: The Quality Domain Example

Ferro, N. and Silvello, G. (2016)
Nat. Conference Paper In Calvanese, D., De Nart, D., and Tasso, C., editors, Digital Libraries on the Move - Proc. 11th Italian Research Conference on Digital Libraries (IRCDL 2015), pages 24-35. Communications in Computer and Information Science (CCIS) 612, Springer, Heidelberg, Germany

Elementi di Basi di Dati, 3 edizione

Agosti, M. and Ferro, N. (2015)
Teaching Monograph Edizioni Libreria Progetto, Padova, Italia

VIRTUE: A visual tool for information retrieval performance evaluation and failure analysis

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2014)
Int. Journal Paper Journal of Visual Languages & Computing (JVLC), 25(4):394-413

CLEF 2014 - Information Access Evaluation meets Multilinguality, Multimodality, and Interaction

Cappellato, L., Clough, P., Ferro, N., Hall, M., Halvey, M., Hanbury, A., Kanoulas, E., Kraaij, W., Lupu, M., Sanderson, M., Toms, E., and Villa, R. (2014)
Journal w/o Peer Review Paper SIGIR Forum, 48(2):55--62

CLEF 15th Birthday: Past, Present, and Future

Ferro, N. (2014)
Journal w/o Peer Review Paper SIGIR Forum, 48(2):31-55

Reliability and Validity - A Guide To Best Practices in IR Evaluation

Ferro, N., Joho, H., Kelly, D., Lewandowski, D., Lioma, C., O'Brien, H., Potthast, M., van Rijsbergen, C. J., Thomas, P., Tran, V., and de Vries, A. P. (2014)
Journal w/o Peer Review Paper In Agosti, M., Fuhr, N., Toms, E., and Vakkari, P., editors, Report from Dagstuhl Seminar 13441: Evaluation Methodologies in Information Retrieval, Dagstuhl Reports, Volume 3, Number 10, pages 111-113. Schloss Dagstuhl--Leibniz-Zentrum für Informatik, Germany

Making it Easier to Discover, Re-Use and Understand Search Engine Experimental Evaluation Data

Ferro, N. and Silvello, G. (2014)
Journal w/o Peer Review Paper ERCIM News, 96:26-27

A Visual Interactive Environment for Making Sense of Experimental Data

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2014)
Int. Conference Paper In de Rijke, M., Kenter, T., de Vries, A. P., Zhai, C., de Jong, F., Radinsky, K., and Hofmann, K., editors, Advances in Information Retrieval. Proc. 36th European Conference on IR Research (ECIR 2014), pages 767-770. Lecture Notes in Computer Science (LNCS) 8416, Springer, Heidelberg, Germany

Injecting User Models and Time into Precision via Markov Chains

Ferrante, M., Ferro, N., and Maistro, M. (2014)
Int. Conference Paper In Geva, S., Trotman, A., Bruza, P., Clarke, C. L. A., and Järvelin, K., editors, Proc. 37th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2014), pages 597-606. ACM Press, New USA

Rethinking How to Extend Average Precision to Graded Relevance

Ferrante, M., Ferro, N., and Maistro, M. (2014)
Int. Conference Paper In Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., and Toms, E., editors, Information Access Evaluation - Multilinguality, Multimodality, and Interaction. Proceedings of the Fifth International Conference of the CLEF Initiative (CLEF 2014), pages 19-30. Lecture Notes in Computer Science (LNCS) 8685, Springer, Heidelberg, Germany

CLEF 15th Birthday: What Can We Learn From Ad Hoc Retrieval?

Ferro, N. and Silvello, G. (2014)
Int. Conference Paper In Kanoulas, E., Lupu, M., Clough, P., Sanderson, M., Hall, M., Hanbury, A., and Toms, E., editors, Information Access Evaluation - Multilinguality, Multimodality, and Interaction. Proceedings of the Fifth International Conference of the CLEF Initiative (CLEF 2014), pages 31-43. Lecture Notes in Computer Science (LNCS) 8685, Springer, Heidelberg, Germany

CLEF 2008 Working Notes

Borri, F., Nardi, A., Peters, C., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1174, ISSN 1613-0073

CLEF 2009 Working Notes

Borri, F., Nardi, A., Peters, C., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1175, ISSN 1613-0073

CLEF 2004 Working Notes

Borri, F., Peters, C., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1170, ISSN 1613-0073

CLEF 2010 Working Notes

Braschler, M., Harman, D. K., Pianta, E., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1176, ISSN 1613-0073

CLEF 2014 Working Notes

Cappellato, L., Ferro, N., Halvey, M., and Kraaij, W., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1180, ISSN 1613-0073

Bridging Between Cultural Heritage Institutions - Proc. 9th Italian Research Conference on Digital Libraries (IRCDL 2013)

Catarci, T., Ferro, N., and Poggi, A., editors (2014)
Editorship Communications in Computer and Information Science (CCIS) 385, Springer, Heidelberg, Germany

Bridging Between Information Retrieval and Databases - PROMISE Winter School 2013, Revised Tutorial Lectures

Ferro, N., editor (2014)
Editorship Lecture Notes in Computer Science (LNCS) 8173, Springer, Heidelberg, Germany

CLEF 2012 Working Notes

Forner, P., Karlgren, J., Womser-Hacker, C., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1178, ISSN 1613-0073

CLEF 2013 Working Notes

Forner, P., Navigli, R., Tufis, D., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1179, ISSN 1613-0073

CLEF 2007 Working Notes

Nardi, A., Peters, C., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1173, ISSN 1613-0073

CLEF 2006 Working Notes

Nardi, A., Peters, C., Vicedo, J. L., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1172, ISSN 1613-0073

CLEF 2000 Working Notes

Peters, C. and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1166, ISSN 1613-0073

CLEF 2001 Working Notes

Peters, C. and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1167, ISSN 1613-0073

CLEF 2002 Working Notes

Peters, C. and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1168, ISSN 1613-0073

CLEF 2003 Working Notes

Peters, C. and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1169, ISSN 1613-0073

CLEF 2005 Working Notes

Peters, C., Quochi, V., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1171, ISSN 1613-0073

CLEF 2011 Working Notes

Petras, V., Forner, P., Clough, P., and Ferro, N., editors (2014)
Editorship CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1177, ISSN 1613-0073

Enhancing Digital Cultural Heritage Collections with Social Network Capabilities

Agosti, M., Ferro, N., Porat, S., and Rabinovich, E. (2014)
Int. Workshop Paper In Oomen, J., Aroyo, L., Gena, C., and Wecker, A. J., editors, Proc. 7th International Workshop on Personalized Access to Cultural Heritage: The Future of Experiencing Cultural Heritage (PATCH 2014)

CULTURA Outcomes for Improving the User's Engagement with Cultural Heritage Collections

Agosti, M., Ferro, N., Orio, N., and Ponchia, C. (2014)
Nat. Conference Paper In Agosti, M., Catarci, T., and Esposito, F., editors, Proc. 10th Italian Research Conference on Digital Libraries (IRCDL 2014), Procedia Computer Science, 38:34-39

Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives

Angelini, M., Ferro, N., Larsen, B., Müller, H., Santucci, G., Silvello, G., and Tsikrika, T. (2014)
Nat. Conference Paper In Agosti, M., Catarci, T., and Esposito, F., editors, Proc. 10th Italian Research Conference on Digital Libraries (IRCDL 2014), Procedia Computer Science, 38:133-137

Enriching Digital Cultural Heritage Collections via Annotations: The CULTURA approach

Agosti, M., Conlan, O., Ferro, N., Hampson, C., Munnelly, G., Ponchia, C., and Silvello, G. (2014)
Nat. Conference Paper In Greco, S. and Picariello, A., editors, Proc. 22nd Italian Symposium on Advanced Database Systems (SEBD 2014)

NESTOR: A Formal Model for Digital Archives

Ferro, N. and Silvello, G. (2013)
Int. Journal Paper Information Processing & Management, 49(6):1206-1240

PROMISE Winter School 2013: Bridging between Information Retrieval and Databases

Agosti, M., Ferro, N., and Silvello, G. (2013)
Journal w/o Peer Review Paper SIGIR Forum, 47(1):46-52

PROMISE Winter School 2013 on Bridging between Information Retrieval and Databases

Ferro, N. (2013)
Journal w/o Peer Review Paper ERCIM News, 93:56-57

CLEF 2013: Information Access Evaluation meets Multilinguality, Multimodality, and Visualization

Ferro, N., Forner, P., Müller, H., Navigli, R., Paredes, R., Rosso, P., Stein, B., and Tufis, D. (2013)
Journal w/o Peer Review Paper SIGIR Forum, 47(2):15-20

CLEF 2013 and Beyond: Evolution of the CLEF Initiative

Ferro, N. and Rosso, P. (2013)
Journal w/o Peer Review Paper ERCIM News, 95:51-52

PROMISE Technology Transfer Day: Spreading the Word on Information Access Evaluation at an Industrial Event

Forner, P., Bentivogli, L., Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., and Müller, H. (2013)
Journal w/o Peer Review Paper SIGIR Forum, 47(1):53-58

Interacting with Digital Cultural Heritage Collections via Annotations: The CULTURA Approach

Agosti, M., Conlan, O., Ferro, N., Hampson, C., and Munnelly, G. (2013)
Int. Conference Paper In Marinai, S. and Marriot, K., editors, Proc. 13th ACM Symposium on Document Engineering (DocEng 2013), pages 13-22. ACM Press, New York, USA

Improving Ranking Evaluation Employing Visual Analytics

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013)
Int. Conference Paper In Forner, P., Müller, H., Paredes, R., Rosso, P., and Stein, B., editors, Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. Proceedings of the Fourth International Conference of the CLEF Initiative (CLEF 2013), pages 29-40. Lecture Notes in Computer Science (LNCS) 8138, Springer, Heidelberg, Germany

Formal Models for Digital Archives: NESTOR and the 5S

Ferro, N. and Silvello, G. (2013)
Int. Conference Paper In Aalberg, T., Papatheodorou, C., Dobreva, M., Tsakonas, G., and Farrugia, C. J., editors, Proc. 17th International Conference on Theory and Practice of Digital Libraries (TPDL 2013), pages 192-203. Lecture Notes in Computer Science (LNCS) 8092, Springer, Heidelberg, Germany

The FAST-CAT: Empowering Cultural Heritage Annotations

Munnelly, G., Hampson, C., Ferro, N., and Conlan, O. (2013)
Int. Conference Paper In Walter, K., Price, K., and Nowviskie, B., editors, Proc. Digital Humanities 2013, pages 320-322. Center for Digital Research in Humanities, USA

Cultural Heritage in CLEF (CHiC) 2013

Petras, V., Bogers, T., Hall, M., Savoy, J., Malak, P., Pawlowski, A., Ferro N., and Masiero, I. (2013)
Int. Conference Paper In Forner, P., Müller, H., Paredes, R., Rosso, P., and Stein, B., editors, Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. Proceedings of the Fourth International Conference of the CLEF Initiative (CLEF 2013), pages 192-211. Lecture Notes in Computer Science (LNCS) 8138, Springer, Heidelberg, Germany

Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012)

Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors (2013)
Editorship Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012)

Information Retrieval Meets Information Visualization - PROMISE Winter School 2012, Revised Tutorial Lectures

Agosti, M., Ferro, N., Forner, P., Müller, H., and Santucci, G., editors (2013)
Editorship Lecture Notes in Computer Science (LNCS) 7757, Springer, Heidelberg, Germany

Keyword Search and Evaluation over Relational Databases: an Outlook to the Future

Bergamaschi, S., Ferro, N., Guerra, F., and Silvello, G. (2013)
Int. Workshop Paper In Koutrika, G. and Theobald, M., editors, Proc. 7th International Workshop on Ranking in Databases (DBRank 2013), pages 1-3. ACM Press, New York, USA

Cultural Heritage in CLEF (CHiC) 2013 - Multilingual Task Overview

Petras, V., Bogers, T., Ferro, N., and Masiero, I. (2013)
Int. Workshop Paper In Forner, P., Navigli, R., Tufis, D., and Ferro, N., editors, CLEF 2013 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1179, ISSN 1613-0073

Cumulated Relative Position: A Metric for Ranking Evaluation

Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2013)
Nat. Conference Paper In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 57-60. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 964, ISSN 1613-0073

Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013)
Nat. Conference Paper In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 61-64. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 964, ISSN 1613-0073

A Visual Analytics Tool for Experimental Evaluation

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013)
Nat. Conference Paper In Buccafurri, F. and Saccà, D., editors, Proc. 21st Italian Symposium on Advanced Database Systems (SEBD 2013), pages 139–150

(Formal) Models for systems, infrastructures, communities

Ferro, N. (2014)
Nat. Conference Paper In Agosti, M. and Tomasi, F., editors, Collaborative Research Practices and Shared Infrastructures for Humanities Computing – Atti del convegno annuale dell’Associazione per l'Informatica Umanistica e la Cultura Digitale (AIUCD 2013), pages 129-134. CLEUP, Padova, Italia, ISBN 978-88-6787-2602

Fostering Interaction with Cultural Heritage Material via Annotations: The FAST-CAT Way

Ferro, N., Munnelly, G., Hampson, C., and Conlan, O. (2014)
Nat. Conference Paper In Catarci, T., Ferro, N., and Poggi, A., editors (2014). Bridging Between Cultural Heritage Institutions - Proc. 9th Italian Research Conference on Digital Libraries (IRCDL 2013), pages 41-52. Communications in Computer and Information Science (CCIS) 385, Springer, Heidelberg, Germany

Digital Archives: Extending the 5S Model through NESTOR

Ferro, N. and Silvello, G. (2014)
Nat. Conference Paper In Catarci, T., Ferro, N., and Poggi, A., editors (2014). Bridging Between Cultural Heritage Institutions - Proc. 9th Italian Research Conference on Digital Libraries (IRCDL 2013), pages 130-135. Communications in Computer and Information Science (CCIS) 385, Springer, Heidelberg, Germany

PROMISE Retreat Report - Prospects and Opportunities for Information Access Evaluation

Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012)
Int. Journal Paper SIGIR Forum, 46(2):60-84

Frontiers, Challenges, and Opportunities for Information Retrieval - Report from SWIRL 2012, The Second Strategic Workshop on Information Retrieval in Lorne, February 2012

Allan, J., Aslam, J., Azzopardi, L., Belkin, N., Borlund, P., Bruza, P., Callan, J., Carman, M. Clarke, C., Craswell, N., Croft, W. B., Culpepper, J. S., Diaz, F., Dumais, S., Ferro, N., Geva, S., Gonzalo, J., Hawking, D., Järvelin, K., Jones, G., Jones, R., Kamps, J., Kando, N., Kanoulas, E., Karlgren, J., Kelly, D., Lease, M., Lin, J., Mizzaro, S., Moffat, A., Murdock, V., Oard, D. W., de Rijke, M., Sakai, T., Sanderson, M., Scholer, F., Si, L., Thom, J., Thomas, P., Trotman, A., Turpin, A., de Vries, A. P., Webber, W., Zhang, X., and Zhang, Y. (2012)
Int. Journal Paper SIGIR Forum, 46(1):2-32

PROMISE Winter School 2012 Information Retrieval meets Information Visualization

Agosti, M., Catarci, T., Ferro, N., Müller, H., and Santucci, G. (2012)
Journal w/o Peer Review Paper SIGIR Forum, 46(1):65-70

DESIRE 2011 Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation

Agosti, M., Ferro, N., and Thanos, C. (2012)
Journal w/o Peer Review Paper SIGIR Forum, 46(1):51-55

CLEF 2012: Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics

Catarci, T., Ferro, N., Forner, P., Hiemstra, D., Karlgren, J., Peñas, A., Santucci, G., and Womser-Hacker, C. (2012)
Journal w/o Peer Review Paper SIGIR Forum, 46(2):29-33

PROMISE Retreat 2012 report on Prospects and Opportunities for Information Access Evaluation

Ferro, N. (2012)
Journal w/o Peer Review Paper ERCIM News, 91:39

CLEF 2012 and beyond: Perspectives for the Conference and Labs of the Evaluation Forum

Ferro, N. (2012)
Journal w/o Peer Review Paper ERCIM News, 91:36-37

The CLEF Initiative: Conference and Labs of the Evaluation Forum

Ferro, N. (2012)
Journal w/o Peer Review Paper ERCIM News, 88:63-64

La gestione e conservazione dei dati scientifici prodotti dalla valutazione sperimentale dei motori di ricerca

Ferro, N. (2012)
Nat. Journal Paper Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina. Parte II: Memorie della Classe di Scienze Matematiche, Fisiche e Naturali, CXXIV:41-52

DIRECTions: Design and Specification of an IR Evaluation Infrastructure

Agosti, M., Di Buccio, E., Ferro, N., Masiero, I., Peruzzo, S., and Silvello, G. (2012)
Int. Conference Paper In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF2012), pages 88-99. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany

Information Retrieval Failure Analysis: Visual analytics as a Support for Interactive What-If Investigation

Angelini, M., Ferro, N., Granato, G. L., Santucci, G., and Silvello, G. (2012)
Int. Conference Paper In Santucci, G. and Ward, M., editors, Proc. IEEE Conference on Visual Analytics Science and Technology (VAST 2012), pages 204-206. IEEE Computer Society, Los Alamitos, CA, USA

Cumulated Relative Position: A Metric for Ranking Evaluation

Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2012)
Int. Conference Paper In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF2012), pages 112-123. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany

Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation

Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2012)
Int. Conference Paper In Kamps, J., Kraaij, W., and Fuhr, N., editors, Proc. 4th Symposium on Information Interaction in Context (IIiX 2012), pages 195-203. ACM Press, New York, USA

PROMISE Retreat Report - Prospects and Opportunities for Information Access Evaluation

Ferro, N., Berendsen, R., Hanbury, A., Lupu, M., Petras, V., de Rijke, M., and Silvello G., editors (2012)
Editorship SIGIR Forum, 46(2):60-84

Proc. 20th Italian Symposium on Advanced Database Systems (SEBD 2012)

Ferro, N. and Tanca, L., editors (2012)
Editorship Edizioni Libreria Progetto, Padova, Italy, ISBN 978-88-96477-23-6

PROMISE Retreat Report: Prospects and Opportunities for Information Access Evaluation

Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012)
Monograph PROMISE network of excellence, ISBN 978-88-6321-039-2

Enciclopedia della Scienza e della Tecnica

AA.VV. (2012)
Monograph Volume VII-VIII. Istituto dell'Enciclopedia italiana fondata da Giovanni Treccani

Cultural Heritage in CLEF (CHiC) Overview 2012

Petras, V., Ferro, ., Gäde, M., Isaac, A., Kleineberg, M., Masiero, I., Nicchio, M., and Stiller, J. (2012)
Int. Workshop Paper In Forner, P., Karlgren, J., Womser-Hacker, C., and Ferro, N., editors, CLEF 2012 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org), Vol. 1178, ISSN 1613-0073

Biblioteche digitali tra modellazione, gestione e valutazione

Agosti, M., Ferro, N., and Silvello, G. (2014)
Nat. Conference Paper In Ciotti, F., editor, Digital Humanities: progetti italiani ed esperienze di convergenza multidisciplinare – Atti del convegno annuale dell'Associazione per l’Informatica Umanistica e la Cultura Digitale (AIUCD 2012), pages 33–50. Quaderni DigiLab, Sapienza Università Editrice, Roma, Italy

Empowering Archives Through Annotations

Ferro, N. and Silvello, G. (2013)
Nat. Conference Paper In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 57-68. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany

Modeling Archives by means of OAI-ORE

Ferro, N. and Silvello, G. (2013)
Nat. Conference Paper In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 216-227. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany

Per il sistema archivistico regionale

Ferro, N. and Silvello, G. (2012)
Nat. Conference Paper In Regione del Veneto, editor, Memoria e innovazione. Nuovi strumenti / Nuove esigenze. Atti della Prima Giornata regionale degli Archivi, pages 91-101. Canova Edizioni, Treviso

CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation

Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V., and de Rijke, M. (2011)
Journal w/o Peer Review Paper SIGIR Forum, 45(2):32-37

DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation

Ferro, N. (2011)
Journal w/o Peer Review Paper ERCIM News, 86:54-55

PROMISE: Advancing the Evaluation of Multilingual and Multimedi Information Systems

Ferro, N. (2011)
Journal w/o Peer Review Paper ERCIM News, 84:49

La rete di eccellenza europea PROMISE

Ferro, N. (2011)
Nat. Journal Paper DigItalia, Rivista del digitale nei beni culturali, 6(1):113-122

DESIRE 2011: First International Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation

Agosti, M., Ferro, N., and Thanos, C. (2011)
Int. Conference Paper In Ounis, I., Ruthven, I., Berendt, B., de Vries, A. P., and Wenfei, F., editors, Proc. 20th International Conference on Information and Knowledge Management (CIKM 2011), pages 2631-2632. ACM Press, New York, USA

To Re-rank or to Re-query: Can Visual Analytics Solve This Dilemma?

Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011)
Int. Conference Paper In Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., and de Rijke, M., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross-Language Evaluation Forum (CLEF 2011), pages 119-130. Lecture Notes in Computer Science (LNCS) 6941, Springer, Heidelberg, Germany

Harnessing the Scientific Data Produced by the Experimental Evaluation of Search Engines and Information Access Systems

Ferro, N., Hanbury, A., Müller, H., and Santucci, G. (2011)
Int. Conference Paper In Sato, M., Matsuoka, S., Sloot, P. M., van Albada, G. D., and Dongarra, J., editors, Proc. 11th International Conference on Computational Science (ICCS 2011), Procedia Computer Science, 4:740-749

Handling Hierarchically Structured Resources Addressing Interoperability Issues in Digital Libraries

Agosti, M., Ferro, N., and Silvello, G. (2011)
Int. Book Chapter In Biba, M. and Xhafa, F., editors, Learning Structure and Schemas from Documents, pages 17-49. Springer-Verlag, Heidelberg, Germany

Proc. Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation (DESIRE 2011)

Agosti, M., Ferro, N., and Thanos, C., editors (2011)
Editorship ACM Press, New York, USA

Interactive Analysis and Exploration of Experimental Evaluation Results

Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011)
Int. Workshop Paper In Wilson, M. L., Russell-Rose, T., Larsen, B., and Kalbach, J., editors, Proc. 1st European Workshop on Human-Computer Interaction and Information Retrieval (EuroHCIR 2011), pages 11-14. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 763, ISSN 1613-0073

Experimental Evaluation and Hypertexts

Ferro, N. (2011)
Int. Workshop Paper In Agosti, M., De Luca, E. W., Lawless, S., and Leveling, J., editors, Proc. First Workshop on Personalised Multilingual Hypertext Retrieval (PMHR 2011), pages 8-9. ACM Press, New York, USA

Visual Comparison of Ranked Result Cumulated Gains

Ferro, N., Sabetta, A., Santucci, G., and Tino, G. (2011)
Int. Workshop Paper In Miksch, S. and Santucci, G., editors, Proc. 2nd International Workshop on Visual Analytics (EuroVA 2011), pages 21-24. Eurographics Association, Goslar, Germany

CHiC 2011 - Cultural Heritage in CLEF: From Use Cases to Evaluation in Practice for Multilingual Information Access to Cultural Heritage

Gäde, M., Ferro, N., and Lestari Paramita, M. (2011)
Int. Workshop Paper In Petras, V., Forner, P., Clough, P., and Ferro, N., editors, CLEF 2011 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1177, ISSN 1613-0073

SIAR: A User-Centric Digital Archive System

Agosti, M., Ferro, N., Rigon, A., Silvello, G., Terenzoni, E., and Tommasi, C. (2011)
Nat. Conference Paper In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 87-99. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany

EuropeanaConnect

Crivellari, F., Deambrosis, G., Di Nunzio, G. M., and Ferro, N. (2011)
Nat. Conference Paper In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 130-131. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany

PROMISE - Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation

Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., and Silvello, G. (2011)
Nat. Conference Paper In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 140-143. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany

The NESTOR Model: Properties and Applications in the Context of Digital Archives

Ferro, N. and Silvello, G. (2011)
Nat. Conference Paper In Mecca, G. and Greco, S., editors, Proc. 19th Italian Symposium on Advanced Database Systems (SEBD 2011), pages 274-285. Università della Basilicata, Italy

CLEF 2010 Conference on Multilingual and Multimodal Information Access Evaluation

Agosti, M., Braschler, M., Choukri, K., Ferro, N., Harman, D. K., Peters, C., Pianta, E., de Rijke, M., and Smeaton, A. (2010)
Journal w/o Peer Review Paper SIGIR Forum, 44(2):8-12

CLEF 2010: Innovation, Science, Experimentation

Ferro, N. (2010)
Journal w/o Peer Review Paper ERCIM News, 83:60

Conferenza CLEF 2010 - Conference on Multilingual and Multimodal Information Access Evaluation

Agosti, M. and Ferro, N. (2010)
Nat. Journal Paper DigItalia, Rivista del digitale nei beni culturali, 5(2):176-180

Interoperabilità tra sistemi di biblioteche digitali

Agosti, M. and Ferro, N. (2010)
Nat. Journal Paper DigItalia, Rivista del digitale nei beni culturali, 5(1):95-112

A PROMISE for Experimental Evaluation

Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., Müller, H., Petras, V., Pianta, E., de Rijke, M., and Santucci, G. (2010)
Int. Conference Paper In Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010), pages 140-144. Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany

CLEF 2009: Grid@CLEF Pilot Track Overview

Ferro, N. and Harman, D. (2010)
Int. Conference Paper In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 552-565. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany

CLEF 2009 Ad Hoc Track Overview: TEL & Persian Tasks

Ferro, N. and Peters, C. (2010)
Int. Conference Paper In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 13-35. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany

Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010)

Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors (2010)
Editorship Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany

Quality and Interoperability: The Quest for the Optimal Balance

Ferro, N. (2010)
Int. Book Chapter In Iglezakis, I., Kapidakis, S., and Synodinou, T., editors, E-Publishing and Digital Libraries: Legal and Organizational Issues, pages 48-68. IGI Global, USA

10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go

Agosti, M., Di Nunzio, G. M., Dussin, M., and Ferro, N. (2010)
Int. Workshop Chapter In Sakay, T., Sanderson, M., and Webber, W., editors, Proc. 3rd International Workshop on Evaluating Information Access (EVIA 2010), pages 16-24. National Institute of Informatics, Tokyo, Japan

CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum

Ferro, N. (2010)
Int. Workshop Chapter In Kando, N. and Kishida, K., editors, Proc. 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 2-12. National Institute of Informatics, Tokyo, Japan

Quality Interoperability within Digital Libraries: the DL.org Perspective

Vullo, G., Clavel, G., Ferro, N., Higgins, S., van Horik, R., Horstmann, W., Kapidakis, S., and Ross, S. (2010)
Int. Workshop Chapter In Castelli, D., Ioannidis, Y., and Ross, S., editors, Pre-proceedings of the Second DL.org Workshop - Making Digital Libraries Interoperable: Challenges and Approaches, pages 12-24

The NESTOR Framework: Manage, Access and Exchange Hierarchical Data Structures

Agosti, M., Ferro, N., and Silvello, G. (2010)
Nat. Conference Paper In Martoglia, R., Bergamaschi, S., Lodi, S., and Sartori, C., editors, Proc. 18th Italian Symposium on Advanced Database Systems (SEBD 2010), pages 242-253. Società Editrice Esculapio, Bologna, Italy

FAST and NESTOR: How to Exploit Annotation Hierarchies

Ferro, N. and Silvello, G. (2010)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Digital Libraries. Proceedings of the Sixth Italian Research Conference (IRCDL 2010), pages 55-66. Communications in Computer and Information Science (CCIS) 91, Springer, Heidelberg, Germany

Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2009)
Journal w/o Peer Review Paper Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1). ISSN 1937-7266

The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large- Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2009)
Journal w/o Peer Review Paper Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1). ISSN 1937-7266

CLEF 2008: Ad Hoc Track Overview

Agirre, E., Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2009)
Int. Conference Paper In Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors, Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross-Language Evaluation Forum (CLEF 2008). Revised Selected Papers, pages 15-37. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany

Access and Exchange of Hierarchically Structured Resources on the Web with the NESTOR Framework

Agosti, M., Ferro, N., and Silvello, G. (2009)
Int. Conference Paper In Baeza-Yates, R., Berendt, B., Bertino, E., Lim, E.-P., and Pasi, G., editors, Proc. 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, pages 659-662. IEEE Computer Society, Los Alamitos, CA, USA

Enabling Cross-Language Access to Archival Metadata

Agosti, M., Ferro, N., and Silvello, G. (2009)
Int. Conference Paper In Cirinnà, C. and Lunghi, M., editors, International Conference on Cultural Heritage Online - Empowering Users: an Active Role for User Communities, pages 179-183. Fondazione Rinascimento Digitale, Firenze, Italy

Managing the Knowledge Creation Process of Large-Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2009)
Int. Conference PaperBest Student Paper Award In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 63-74. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany

Annotation Search: The FAST Way

Ferro, N. (2009)
Int. Conference Paper In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 15-26. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany

The NESTOR Framework: How to Handle Hierarchical Data Structures

Ferro, N. and Silvello, G. (2009)
Int. Conference Paper In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 215-226. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany

Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross–Language Evaluation Forum (CLEF 2008). Revised Selected Papers

Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors (2009)
Editorship Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany

Towards an Evaluation Infrastructure for DL Performance Evaluation

Agosti, M. and Ferro, N. (2009)
Int. Book Chapter In Tsakonas, G. and Papatheodorou, C., editors, Evaluation of Digital Libraries: An Insight to Useful Applications and Methods, pages 93-120. Chandos Publishing, Oxford, UK

CLEF 2009: Grid@CLEF Pilot Track Overview

Ferro, N. and Harman, D. (2009)
Int. Workshop Paper In Borri, F., Nardi, A., Peters, C., and Ferro, N., editors, CLEF 2009 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1175, ISSN 1613-0073

CLEF 2009 Ad Hoc Track Overview: TEL & Persian Tasks

Ferro, N. and Peters, C. (2009)
Int. Workshop Paper In Borri, F., Nardi, A., Peters, C., and Ferro, N., editors, CLEF 2009 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1175, ISSN 1613-0073

Design of an Information Retrieval System Based on the Peer-to-Peer Paradigm: An Application to Music Retrieval

Di Buccio, E., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2009)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 100-107. DELOS Association and Department of Information Engineering of the University of Padua

The FAST Annotation Service

Ferro, N. (2009)
Nat. Conference Paper In De Antonellis, V., Castano, S., Catania, B., and Guerrini, G., editors, Proc. 17th Italian Symposium on Advanced Database Systems (SEBD 2009), pages 169-176. Seneca Edizioni, Torino, Italia

CLEF Ad-hoc: A Perspective on the Evolution of the Cross-Language Evaluation Forum

Ferro, N. and Peters, C. (2009)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 72-79. DELOS Association and Department of Information Engineering of the University of Padua

Design and Development of the Data Model of a Distributed DLS Architecture for Archive Metadata

Ferro, N. and Silvello, G. (2009)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 12-21. DELOS Association and Department of Information Engineering of the University of Padua

Metodologie e percorsi interdisciplinari per la ideazione di un Sistema Informativo Archivistico

Agosti, M., Bonfiglio-Dosio, G., Ferro, N., and Silvello, G. (2008)
Nat. Journal Paper Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina, CXX:261-287

Annotations: a Way to Interoperability in DL

Agosti, M. and Ferro, N. (2008)
Int. Conference Paper In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 291-295. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany

CLEF 2007: Ad Hoc Track Overview

Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2008)
Int. Conference Paper In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, pages 13-32. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany

DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2008)
Int. Conference Paper In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 424. ACM Press, New York, USA

The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large-Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2008)
Int. Conference Paper In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 450. ACM Press, New York, USA

Design of a Digital Library System for Large-Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2008)
Int. Conference Paper In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 400-401. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany

A Methodology for Sharing Archival Descriptive Metadata in a Distributed Environment

Ferro, N. and Silvello, G. (2008)
Int. Conference Paper In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 268-279. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany

GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview

Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Larson, R., Sanderson, M., Santos, D., Womser-Hacker, C., and Xie, X. (2008)
Int. Conference Paper In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, 745-772. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany

An Evaluation Resource For Geographic Information Retrieval

Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Sanderson, M., Santos, D., and Womser-Hacker, C. (2008)
Int. Conference Paper In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008)

How Robust are Multilingual Information Retrieval Systems?

Mandl, T., Womser-Hacker, C., Di Nunzio, G. M., and Ferro, N. (2008)
Int. Conference Paper In Wainwright, R. L., and Haddad, H. M., editors, Proc. 2008 ACM Symposium on Applied Computing (SAC 2008), pages 1132-1136. ACM Press, New York, USA

From Research to Application in Multilingual Information Access: the Contribution of Evaluation

Peters, C., Braschler, M., Di Nunzio, G. M., Ferro, N., Gonzalo, J., and Sanderson, M. (2008)
Int. Conference Paper In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008)

Workshop on Novel Methodologies for Evaluation in Information Retrieval

Sanderson, M., Braschler, M., Ferro, N., and Gonzalo, J. (2008)
Int. Conference Paper In Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., and White, R. W ., editors, Advances in Information Retrieval. Proc. 30th European Conference on IR Research (ECIR 2008), page 750. Lecture Notes in Computer Science (LNCS) 4956, Springer, Heidelberg, Germany

A Statistical and Graphical Methodology for Comparing Bilingual to Monolingual Cross-Language Information Retrieval

Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2008)
Int. Book Chapter In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 171-188. Springer-Verlag, Heidelberg, Germany

Digital Annotations: a Formal Model and its Applications

Ferro, N. (2008)
Int. Book Chapter In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 113-146. Springer-Verlag, Heidelberg, Germany

CLEF 2008: Ad Hoc Track Overview

Agirre, E., Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2008)
Int. Workshop Paper In Borri, F., Nardi, A., Peters, C., and Ferro, N., editors, CLEF 2008 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1174, ISSN 1613-0073

The Design of a DLS for the Management of Very Large Collections of Archival Objects

Agosti, M., Ferro, N., and Silvello, G. (2008)
Int. Workshop Paper In Manghi, P., Pagano, P., and Zezula, P., editors, Proc. 1st Workshop on Very Large Digital Libraries (VLDL 2008). DELOS: an Association for Digital Libraries.

From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum

Ferro, N. and Peters, C. (2008)
Int. Workshop Paper In Kando, N. and Sugimoto, M., editors, Proc. 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 577-593. National Institute of Informatics, Tokyo, Japan

GeoCLEF 2008: the CLEF 2008 Cross-Language Geographic Information Retrieval Track Overview

Mandl, T., Carvalho, P., Gey, F., Larson, R., Santos, D., Womser-Hacker, K., Di Nunzio, G. M., and Ferro, N. (2008)
Int. Workshop Paper In Borri, F., Nardi, A., Peters, C., and Ferro, N., editors, CLEF 2008 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1174, ISSN 1613-0073

Adding Advanced Annotation Functionalities to an Existing Digital Library System

Agosti, M. and Ferro, N. (2008)
Nat. Conference Paper In D'Atri, A., De Marco, M., and Casalino, N., editors, Interdisciplinary Aspects of Information Systems Studies, pages 279-286. Physica-Verlag, Heidelberg, Germany

Towards a Superimposed Peer Infrastructure for iNformation Access

Di Buccio, E., Ferro, N., and Melucci, M. (2008)
Nat. Conference Paper In Gaglio, S., Infantino, I., and Saccà, D., editors, Proc. 16th Italian Symposium on Advanced Database Systems (SEBD 2008), pages 398-405. Fotograf, Palermo, Italy

Content-based Information Retrieval in SPINA

Di Buccio, E., Ferro, N., and Melucci, M. (2008)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 89-92. ISTI-CNR at Gruppo ALI, Pisa, Italy

The Design of the User Interface of a Scientific DLS in the context of the Data, Information, Knowledge and Wisdom Hierarchy

Dussin, M. and Ferro, N. (2008)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 105-113. ISTI-CNR at Gruppo ALI, Pisa, Italy

Dealing with MultiLingual Information Access: Grid Experiments at TrebleCLEF

Ferro, N. and Harman, D. (2008)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 29-32. ISTI-CNR at Gruppo ALI, Pisa, Italy

A Distributed Digital Library System Architecture for Archive Metadata

Ferro, N. and Silvello, G. (2008)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 99-104. ISTI-CNR at Gruppo ALI, Pisa, Italy

A Formal Model of Annotations of Digital Content

Agosti, M. and Ferro, N. (2007)
Int. Journal Paper ACM Transactions on Information Systems (TOIS), 26(1):3:1-3:57

A Historical and Contemporary Study on Annotations to Derive Key Features for Systems Design

Agosti, M., Bonfiglio-Dosio, G., and Ferro, N. (2007)
Int. Journal Paper International Journal on Digital Libraries, 8(1):1-19

Proposta metodologica e architetturale per la gestione distribuita e condivisa di collezioni di documenti digitali

Agosti, M., Ferro, N., and Silvello, G. (2007)
Nat. Journal Paper Archivi, 2(2):49-73

DelosDLMS - the Integrated DELOS Digital Library Management System

Agosti, M., Berretti, S., Brettlecker, G., del Bimbo, A., Ferro, N., Fuhr, N., Keim, D., Klas, C.-P., Lidy, T., Milano, D., Norrie, M., Ranaldi, P., Rauber, A., Schek, H.-J., Schreck, T., Schuldt, H., Signer, B., and Springmann, M. (2007)
Int. Conference Paper In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 36-45. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany

Roadmap for MultiLingual Information Access in The European Library

Agosti, M., Braschler, M., Ferro, N., Peters, C., and Siebinga, S. (2007)
Int. Conference Paper In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 136-147. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany

Annotations and Digital Libraries: Designing Adequate Test-beds

Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007)
Int. Conference Paper In Goh, D. H. L., Cao, T. H., Sølvberg, I., and Rasmussen, E., editors, Proc. 10th International Conference on Asian Digital Libraries. Digital Libraries - Asian Digital libraries: Looking Back 10 Years and Forging New Frontiers (ICADL 2007), pages 150-159. Lecture Notes in Computer Science (LNCS) 4822, Springer, Heidelberg, Germany

An Approach for the Construction of an Experimental Test Collection to Evaluate Search Systems that Exploit Annotations

Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007)
Int. Conference Paper In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 167-176. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany

Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them?

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007)
Int. Conference Paper In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 11-20. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany

The Importance of Scientific Data Curation for Evaluation Campaigns

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007)
Int. Conference Paper In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 157-166. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany

The Future of Large-scale Evaluation Campaigns for Information Retrieval in Europe

Agosti, M., Di Nunzio, G. M., Ferro, N., Harman, D., and Peters, C. (2007)
Int. Conference Paper In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 509-512. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany

An Architecture to Share Metadata among Geographically Distributed Archives

Agosti, M., Ferro, N., and Silvello, G. (2007)
Int. Conference Paper In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 56-65. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany

Adding MultiLingual Information Access to The European Library

Braschler, M. and Ferro, N. (2007)
Int. Conference Paper In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 218-227. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany

How to Compare Bilingual to Monolingual Cross-Language Information Retrieval

Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2007)
Int. Conference Paper In Amati, G., Carpineto, C., and Romano, G., editors, Advances in Information Retrieval. Proc. 29th European Conference on IR Research (ECIR 2007), pages 533-540. Lecture Notes in Computer Science (LNCS) 4425, Springer, Heidelberg, Germany

CLEF 2006: Ad Hoc Track Overview

Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2007)
Int. Conference Paper In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 21-34. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany

GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview

Gey, F., Larson, R., Sanderson, M., Bischoff, K., Mandl, T., Womser-Hacker, K., Santos, D., Rocha, P., Di Nunzio, G. M., and Ferro, N. (2007)
Int. Conference Paper In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 852-876. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany

DelosDLMS - the Integrated DELOS Digital Library Management System

Agosti, M., Berretti, S., Brettlecker, G., del Bimbo, A., Ferro, N., Fuhr, N., Keim, D., Klas, C.-P., Lidy, T., Norrie, M., Ranaldi, P., Rauber, A., Schek, H.-J., Schreck, T., Schuldt, H., Signer, B., and Springmann, M. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, DELOS Conference 2007 Working Notes, pages 71-80. ISTI-CNR, Gruppo ALI, Pisa, Italy

A Study of Web Logs for Personalizing the MultiLingual Information Access to The European Library

Agosti, M., Coppotelli, T., Di Nunzio, G. M., Ferro, N., and van der Meulen, E. (2007)
Int. Workshop Paper In Christodoulakis, S., editor, Workshop on Cross-Media and Personalized Learning Applications on top of Digital Libraries (LADL 2007), pages 19-28

Exploiting Relevance Assessment for the Creation of an Experimental Test Collection to Evaluate Systems that Use Annotations

Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, DELOS Conference 2007 Working Notes, pages 195-202. ISTI-CNR, Gruppo ALI, Pisa, Italy

The Importance of Scientific Data Curation for Evaluation Campaigns

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, DELOS Conference 2007 Working Notes, pages 185-193. ISTI-CNR, Gruppo ALI, Pisa, Italy

A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007)
Int. Workshop Paper In Sakai, T. and Sanderson, M., and Evans, D. K., editors, Proc. 1st International Workshop on Evaluating Information Access (EVIA 2007), pages 62-73. National Institute of Informatics, Tokyo, Japan

CLEF: Ongoing Activities and Plans for the Future

Agosti, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2007)
Int. Workshop Paper In Kando, N. and Evans, D. K., editors, Proc. 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 493-504. National Institute of Informatics, Tokyo, Japan

Towards a Reference Quality Model for Digital Libraries

Agosti, M., Ferro, N., Fox, E. A., Gonçalves, M. A., and Lagoeiro, B. (2007)
Int. Workshop Paper In Castelli, D. and Fox, E. A., editors, Pre-proceedings of the First International Workshop on Foundations of Digital Libraries, pages 37-42.

Modelling DL Quality: a Comparison between Approaches: the DELOS Reference Model and the 5S Model

Agosti, M., Ferro, N., Fox, E. A., and Gonçalves, M. A. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, Second DELOS Conference on Digital Libraries Working Notes. ISTI-CNR, Gruppo ALI, Pisa, Italy

Design and Development of a Digital Archive of Illuminated Manuscripts

Agosti, M., Ferro, N., and Orio, N. (2007)
Int. Workshop Paper In del Bimbo, A., Cucchiara, R., and Boujemaa, N., editors, Proc. International Workshop on Visual and Multimedia Digital Libraries (WMDL 2007), pages 113-118. IEEE Computer Society, Los Alamitos, CA, USA

An Architecture to Share Metadata among Geographically Distributed Archives

Agosti, M., Ferro, N., and Silvello, G. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, DELOS Conference 2007 Working Notes, pages 231-239. ISTI-CNR, Gruppo ALI, Pisa, Italy

From CLEF to TrebleCLEF: promoting Technology Transfer for Multilingual Information Retrieval

Braschler, M., Di Nunzio, G. M., Ferro, N., Gonzalo, J., Peters, C., and Sanderson, M. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, Second DELOS Conference on Digital Libraries Working Notes. ISTI-CNR, Gruppo ALI, Pisa, Italy

Adding MultiLingual Information Access to The European Library TEL

Braschler, M. and Ferro, N. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, DELOS Conference 2007 Working Notes, pages 39-49. ISTI-CNR, Gruppo ALI, Pisa, Italy

CLEF 2007: Ad Hoc Track Overview

Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2007)
Int. Workshop Paper In Nardi, A., Peters, C., and Ferro, N., editors, CLEF 2007 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1173, ISSN 1613-0073

Design of the User Interface of a Scientific Digital Library System for Large-Scale Evaluation Campaigns

Dussin, M. and Ferro, N. (2007)
Int. Workshop Paper In Thanos, C. and Borri, F., editors, Second DELOS Conference on Digital Libraries Working Notes. ISTI-CNR, Gruppo ALI, Pisa, Italy

GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview

Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Larson, R., Sanderson, M., Santos, D., Womser-Hacker, C., and Xie, X. (2007)
Int. Workshop Paper In Nardi, A., Peters, C., and Ferro, N., editors, CLEF 2007 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1173, ISSN 1613-0073

The DELOS Digital Library Reference Model. Foundations for Digital Libraries

Candela, L., Castelli, D., Ferro, N., Ioannidis, Y. E., Koutrika, G., Meghini, C., Pagano, P., Ross, S., Soergel, D., Agosti, M., Dobreva, M., Katifori, V., and Schuldt, H. (2007)
Monograph ISTI-CNR at Gruppo ALI, Pisa, Italy

Extending the DelosDLMS by the FAST Annotation Service

Agosti, M., Brettlecker, G., Ferro, N., Ranaldi, P., and Schuldt, H. (2007)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 7-12. ISTI-CNR at Gruppo ALI, Pisa, Italy

Construction of an Annotation Test Collection for Search Evaluation on Digital Libraries

Agosti, M., Coppotelli, T., and Ferro, N. (2007)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 15-17. ISTI-CNR at Gruppo ALI, Pisa, Italy

Distributed Information Retrieval and Automatic Identification of Music Works in SAPIR

Agosti, M., Di Buccio, E., Di Nunzio, G. M., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2007)
Nat. Conference Paper In Ceci, M., Malerba, D., and Tanca, L., editors, Proc. 15th Italian Symposium on Advanced Database Systems (SEBD 2007), pages 479-482. Sagraf srl, Z.I. Capurso, Bari, Italia

Annotations as a Tool for Disclosing Hidden Relationships between Illuminated Manuscripts

Agosti, M., Ferro, N., and Orio, N. (2007)
Nat. Conference Paper In Basili, R. and Pazienza, M. T., editors, Proc. 10th Congress of the Italian Association for Artificial Intelligence. Artificial Intelligence and Human-Oriented Computing (AI*IA 2007), pages 662-673. Lecture Notes in Computer Science (LNCS) 4733, Springer, Heidelberg, Germany

An Effective User Interface for a Scientific DLS to Support Information Retrieval Evaluation

Dussin, M. and Ferro, N. (2007)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 18-21. ISTI-CNR at Gruppo ALI, Pisa, Italy

Annotations: What We Learned from DELOS

Ferro, N., Marcante, A., Martin, A., and Panizzi, E. (2007)
Nat. Conference Paper In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 13-14. ISTI-CNR at Gruppo ALI, Pisa, Italy

Elementi di Basi di Dati, 2 edizione

Agosti, M. and Ferro, N. (2007)
Teaching Monograph Edizioni Libreria Progetto, Padova, Italia

Search Strategies for Finding Annotations and Annotated Documents: the FAST Service

Agosti, M. and Ferro, N. (2006)
Int. Conference Paper In Legind Larsen, H., Pasi, G., Ortiz-Arroyo, D., Andreasen, T., and Christiansen, H., editors, Proc. 7th International Conference on Flexible Query Answering Systems (FQAS 2006), pages 270-281. Lecture Notes in Artificial Intelligence (LNAI) 4027, Springer, Heidelberg, Germany

Graph-based Automatic Suggestion of Relationships among Images of Illuminated Manuscripts

Agosti, M., Ferro, N., and Orio, N. (2006)
Int. Conference Paper In Haddad, H. M., Liebrock, K. M., Chbeir, R., Palakal, M. J., Ossowski, S., Yetongnoon, K., Wainwright, R. L., and Nicolle, C., editors, Proc. 21st ACM Symposium on Applied Computing (SAC 2006), pages 1063-1067. ACM Press, New York, USA

Annotation as a Support to User Interaction for Content Enhancement in Digital Libraries

Agosti, M., Ferro, N., Panizzi, E., and Trinchese, R. (2006)
Int. Conference Paper In Celentano, A. and Mussio, P., editors, Proc. Working Conference on Advanced Visual Interfaces (AVI 2006), pages 151-154. ACM Press, New York, USA

Scientific Evaluation of a DLMS: a service for evaluating information access components

Di Nunzio, G. M. and Ferro, N. (2006)
Int. Conference Paper In Gonzalo, J., Thanos, C., Verdejo, M. F., and Carrasco, R. C., editors, Proc. 10th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2006), pages 536-539. Lecture Notes in Computer Science (LNCS) 4172, Springer, Heidelberg, Germany

CLEF 2005: Ad Hoc Track Overview

Di Nunzio, G. M., Ferro, N., Jones, G. J. F., and Peters, C. (2006)
Int. Conference Paper In Peters, C., Gey, F. C., Gonzalo, J., Jones, G. J. F., Kluck, M., Magnini, B., Müller, H., and de Rijke, M., editors, Accessing Multilingual Information Repositories: Sixth Workshop of the Cross-Language Evaluation Forum (CLEF 2005). Revised Selected Papers, pages 11-36. Lecture Notes in Computer Science (LNCS) 4022, Springer, Heidelberg, Germany

DiLAS: a Distributed Service for the Management of Annotations

Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Panizzi, E., Pejtersen, A. M., and Thiel, U. (2006)
Int. Workshop Paper In Thanos, C., editor, DELOS Research Activities 2006, pages 119-120. ISTI-CNR at Gruppo ALI, Pisa, Italy

A Study on how to Enhance TEL with Multilingual Information Access

Agosti, M., Braschler, M., and Ferro, N. (2006)
Int. Workshop Paper In Thanos, C., editor, DELOS Research Activities 2006, pages 119-120. ISTI-CNR at Gruppo ALI, Pisa, Italy

Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them?

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006)
Int. Workshop Paper In Nardi, A., Peters, C., Vicedo, J. L., and Ferro, N., editors, CLEF 2006 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1172, ISSN 1613-0073

A Data Curation Approach to Support In-depth Evaluation Studies

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006)
Int. Workshop Paper In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 65-68

Integration of the DiLAS Annotation Service into Digital Library Infrastructures

Agosti, M., Ferro, N., Frommholz, I., Panizzi, E., Putz, W., and Thiel, U. (2006)
Int. Workshop Paper In Blandford, A. and Gow, J., editors, Proc. 1st International Workshop on Digital Libraries in the Context of Users Broader Activities (DL-CUBA 2006), pages 1-4

Implementing MLIA in an existing DL system

Braschler, M., Ferro, N., and Verleyen, J. (2006)
Int. Workshop Paper In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 73-76

Queries and Relevance Assessments: The Right Context for the Right Topic

Di Nunzio, G. M. and Ferro, N. (2006)
Int. Workshop Paper In Joho, H., Urban, J., Villa, R., Jose, J. M., and van Rijsbergen, C. J., editors, First International Workshop on Adaptive Information Retrieval (AIR 2006), pages 26-27

CLEF 2006: Ad Hoc Track Overview

Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2006)
Int. Workshop Paper In Nardi, A., Peters, C., Vicedo, J. L., and Ferro, N., editors, CLEF 2006 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1172, ISSN 1613-0073

A Study on the User Interface Design for TEL, and on Additional User Services

Ferro, N., Fuhr, N., Panizzi, E., Santucci, G., and Rauber, A. (2006)
Int. Workshop Paper In Thanos, C., editor, DELOS Research Activities 2006, pages 119-120. ISTI-CNR at Gruppo ALI, Pisa, Italy

GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview

Gey, F., Larson, R., Sanderson, M., Bischoff, K., Mandl, T., Womser-Hacker, K., Santos, D., Rocha, P., Di Nunzio, G. M., and Ferro, N. (2006)
Int. Workshop Paper In Nardi, A., Peters, C., Vicedo, J. L., and Ferro, N., editors, CLEF 2006 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1172, ISSN 1613-0073

Uniform Methodology for Evaluating Information Access Components of Digital Libraries

Di Nunzio, G. M. and Ferro, N. (2006)
Nat. Conference Paper In Agosti, M. and Thanos, C., editors, Proc. 2nd Italian Research Conference on Digital Library Management Systems (IRCDL 2006), pages 25-28. ISTI-CNR at Gruppo ALI, Pisa, Italy

A Probabilistic Model for Stemmer Generation

Bacchin, M., Ferro, N., and Melucci, M. (2005)
Int. Journal Paper Information Processing & Management, 41(1):121-137

Annotations as Context for Searching Documents

Agosti, M. and Ferro, N. (2005)
Int. Conference PaperBest Student Paper Award In Crestani, F. and Ruthven, I., editors, Proc. 5th International Conference on Conceptions of Library and Information Science - Context: nature, impact and role (Colis 5), pages 155-170. Lecture Notes in Computer Science (LNCS) 3507, Springer, Heidelberg, Germany

A System Architecture as a Support to a Flexible Annotation Service

Agosti, M. and Ferro, N. (2005)
Int. Conference Paper In Türker, C., Agosti, M., and Schek, H.-J., editors, Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures: 6th Thematic Workshop of the EU Network of Excellence DELOS. Revised Selected Papers, pages 147-166. Lecture Notes in Computer Science (LNCS) 3664, Springer, Heidelberg, Germany

Annotating Illuminated Manuscripts: an Effective Tool for Research and Education

Agosti, M., Ferro, N., and Orio, N. (2005)
Int. Conference Paper In Marlino, M., Sumner, T., and Shipman, F., editors, Proc. 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), pages 121-130. ACM Press, New York, USA

CLEF 2004: Ad Hoc Track Overview and Results Analysis

Braschler, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2005)
Int. Conference Paper In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 10-26. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany

DIRECT: a System for Evaluating Information Access Components of Digital Libraries

Di Nunzio, G. M. and Ferro, N. (2005)
Int. Conference Paper In Rauber, A., Christodoulakis, S., and Min Tjoa, A., editors, Proc. 9th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2005), pages 483-484. Lecture Notes in Computer Science (LNCS) 3652, Springer, Heidelberg, Germany

Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources

Di Nunzio, G. M., Ferro, N., and Orio, N. (2005)
Int. Conference Paper In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 60-72. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany

DiLAS: a Digital Library Annotation Service

Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Orio, N., Panizzi, E., Pejtersen, A. M., and Thiel, U. (2005)
Int. Workshop Paper In Boujut, J.-F., editor, Proc. International Workshop on Annotation for Collaboration - Methods, Tools, and Practices (IWAC 2005), pages 91-101. CNRS - Programme société de l'information

Design, Implementation, and Evaluation of the Use of Annotations in Interactive and Collaborative DL Access

Agosti, M., Ferro, N., Albrechtsen, H., Frommholz, I., Panizzi, E., and Thiel, U. (2005)
Int. Workshop Paper In Thanos, C., editor, DELOS Research Activities 2005, pages 51-52. ISTI-CNR, Gruppo ALI, Pisa, Italy

Annotations as a Support to Research Users

Agosti, M., Ferro, N., and Orio, N. (2005)
Int. Workshop Paper In Catarci, T., Christodoulakis, S., and Del Bimbo, A., editors, Proc. 7th International Workshop of the EU Network of Excellence DELOS on Audio-Visual Content and Information Visualization in Digital Libraries (AVIVDiLib'05), pages 117-120. Centromedia, Viareggio, Italy

DIRECT: a Distributed Tool for Information Retrieval Evaluation Campaigns

Di Nunzio, G. M. and Ferro, N. (2005)
Int. Workshop Paper In Ioannidis, Y., Schek, H.-J., and Weikum, G., editors, Proc. 8th DELOS Thematic Workshop on Future Digital Library Management Systems: System Architecture and Information Access, pages 58-63

CLEF 2005: Ad Hoc Track Overview

Di Nunzio, G. M., Ferro, N., Jones, G. J. F., and Peters, C. (2005)
Int. Workshop Paper In Peters, C., Quochi, V., and Ferro, N., editors, CLEF 2005 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1171, ISSN 1613-0073

Design Choices for a Flexible Annotation Service

Ferro, N. (2005)
Nat. Conference Paper In Agosti, M. and Thanos, C., editors, Post-proceedings of the First Italian Research Conference on Digital Library Management Systems (IRCDL 2005), pages 101-110. ISTI-CNR at Gruppo ALI, Pisa, Italy

Annotations in Digital Libraries and Collaboratories - Facets, Models and Usage

Agosti, M., Ferro, N., Frommholz, I., and Thiel, U. (2004)
Int. Conference Paper In Heery, R. and Lyon, L., editors, Proc. 8th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2004), pages 244-255. Lecture Notes in Computer Science (LNCS) 3232, Springer, Heidelberg, Germany

Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation

Di Nunzio, G. M., Ferro, N., Melucci, M., and Orio, N. (2004)
Int. Conference Paper In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Comparative Evaluation of Multilingual Information Access Systems: Fourth Workshop of the Cross-Language Evaluation Forum (CLEF 2003) Revised Selected Papers, pages 220-235. Lecture Notes in Computer Science (LNCS) 3237, Springer, Heidelberg, Germany

Evaluation of a Digital Library System

Agosti, M., Di Nunzio, G. M., and Ferro, N. (2004)
Int. Workshop Paper In Agosti, M. and Fuhr, N., editors, Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries, pages 73-78

An Information Service Architecture for Annotations

Agosti, M. and Ferro, N. (2004)
Int. Workshop Paper In Agosti, M., Schek, H.-J., and Türker, C., editors, Digital Library Architectures: Peer-to-Peer, Grid, and Service-Orientation, Pre-proceedings of the 6th Thematic Workshop of the EU Network of Excellence DELOS, pages 115-126. Edizioni Libreria Progetto, Padova, Italy

The University of Padua at CLEF 2004: Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources

Di Nunzio, G. M., Ferro, N., and Orio, N. (2004)
Int. Workshop Paper In Borri, F., Peters, C., and Ferro, N., editors, CLEF 2004 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1170, ISSN 1613-0073

Formal Model and Conceptual Architecture of the Annotation Service for Dynamic Ubiquitous Knowledge Environments

Ferro, N. (2004)
PhD Thesis PhD thesis, Department of Information Engineering. University of Padua, Italy

A Probabilistic Model for Stemmer Generation

Bacchin, M., Ferro, N., and Melucci, M. (2004)
Nat. Conference Paper In Agosti, M., Dessì, N., and Schreiber, F. A., editors, Proc. 12th Italian Symposium on Advanced Database Systems (SEBD 2004), pages 230-237. LITHOSgrafiche, Cagliari, Italy

Improving the Automatic Retrieval of Text Documents

Agosti, M., Bacchin, M., Ferro, N., and Melucci, M. (2003)
Int. Conference Paper In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Advances in Cross-Language Information Retrieval: Third Workshop of the Cross-Language Evaluation Forum (CLEF 2002) Revised Papers, pages 279-290. Lecture Notes in Computer Science (LNCS) 2785, Springer, Heidelberg, Germany

Annotations: Enriching a Digital Library

Agosti, M. and Ferro, N. (2003)
Int. Conference Paper In Koch, T. and Sølvberg, I. T., editors, Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pages 88-100. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany

Managing the Interactions between Handheld Devices, Mobile Applications, and Users

Agosti, M. and Ferro, N. (2003)
Int. Book Chapter In Lim, E. P. and Siau, K., editors, Advances in Mobile Commerce Technologies, pages 204-233. Idea Group, Hershey, USA

The University of Padova at CLEF 2003: Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation

Di Nunzio, G. M., Ferro, N., Melucci, M., and Orio, N. (2003)
Int. Workshop Paper In Peters, C. and Ferro, N., editors, CLEF 2003 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1169, ISSN 1613-0073

Elementi di Basi di Dati

Agosti, M. and Ferro, N. (2003)
Teaching Monograph Edizioni Libreria Progetto, Padova, Italia

The Effectiveness of a Graph-based Algorithm for Stemming

Bacchin, M., Ferro, N., and Melucci, M. (2002)
Int. Conference Paper In Lim, E. P., Foo, S., Khoo, C. S. G., Chen, H., Fox, E. A., Urs, S. R., and Thanos, C., editors, Proc. 5th International Conference on Asian Digital Libraries. Digital Libraries: People, Knowledge, and Technology (ICADL 2002), pages 117-128. Lecture Notes in Computer Science (LNCS) 2555, Springer, Heidelberg, Germany

University of Padua at CLEF 2002: Experiments to Evaluate a Statistical Stemming Algorithm

Bacchin, M., Ferro, N., and Melucci, M. (2002)
Int. Workshop Paper In Peters, C. and Ferro, N., editors, CLEF 2002 Working Notes. CEUR Workshop Proceedings (CEUR-WS.org) Vol. 1168, ISSN 1613-0073