![](https://dblp.uni-trier.de/img/logo.ua.320x120.png)
![](https://dblp.uni-trier.de/img/dropdown.dark.16x16.png)
![](https://dblp.uni-trier.de/img/peace.dark.16x16.png)
Остановите войну!
for scientists:
![search dblp search dblp](https://dblp.uni-trier.de/img/search.dark.16x16.png)
![search dblp](https://dblp.uni-trier.de/img/search.dark.16x16.png)
default search action
Ian Soboroff
Person information
- affiliation: National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA
Refine list
![note](https://dblp.uni-trier.de/img/note-mark.dark.12x12.png)
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
Journal Articles
- 2024
- [j34]Leif Azzopardi, Charles L. A. Clarke, Paul B. Kantor, Bhaskar Mitra, Johanne R. Trippas, Zhaochun Ren, Mohammad Aliannejadi, Negar Arabzadeh, Raman Chandrasekar, Maarten de Rijke, Panagiotis Eustratiadis, William R. Hersh, Jin Huang, Evangelos Kanoulas, Jasmin Kareem, Yongkang Li, Simon Lupart, Kidist Amde Mekonnen, Adam Roegiest, Ian Soboroff, Fabrizio Silvestri, Suzan Verberne, David Vos, Eugene Yang, Yuyue Zhao:
Report on the Search Futures Workshop at ECIR 2024. SIGIR Forum 58(1): 1-41 (2024) - 2022
- [j33]Gareth J. F. Jones, Maria Eskevich, Ben Carterette, Joana Correia, Rosie Jones, Jussi Karlgren, Ian Soboroff:
Report on the 1st Workshop on Audio Collection Human Interaction (AudioCHI 2022) at CHIIR 2022. SIGIR Forum 56(1): 7:1-7:5 (2022) - 2021
- [j32]Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang
, William R. Hersh:
Searching for scientific evidence in a pandemic: An overview of TREC-COVID. J. Biomed. Informatics 121: 103865 (2021) - [j31]Chao-Hong Liu, Alina Karakanta, Audrey Tong, Oleg Aulov, Ian Soboroff, Jonathan Washington, Xiaobing Zhao:
Introduction to the second issue on machine translation for low-resource languages. Mach. Transl. 35(1): 1-2 (2021) - 2020
- [j30]Ian Soboroff, George Awad, Asad A. Butt, Keith Curtis:
Evaluating Multimedia and Language Tasks. Frontiers Artif. Intell. 3: 32 (2020) - [j29]Kirk Roberts
, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees
, Lucy Lu Wang
, William R. Hersh
:
TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19. J. Am. Medical Informatics Assoc. 27(9): 1431-1436 (2020) - [j28]Chao-Hong Liu, Alina Karakanta, Audrey Tong, Oleg Aulov, Ian Soboroff, Jonathan Washington, Xiaobing Zhao:
Introduction to the Special Issue on Machine Translation for Low-Resource Languages. Mach. Transl. 34(4): 247-249 (2020) - [j27]Ellen M. Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang:
TREC-COVID: constructing a pandemic information retrieval test collection. SIGIR Forum 54(1): 1:1-1:12 (2020) - 2019
- [j26]Richard McCreadie
, Shahzad Rajput, Ian Soboroff, Craig Macdonald
, Iadh Ounis:
On enhancing the robustness of timeline summarization test collections. Inf. Process. Manag. 56(5): 1815-1836 (2019) - 2018
- [j25]Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, Joseph A. Konstan, Pablo Castells, Elizabeth M. Daly, Thierry Declerck, Michael D. Ekstrand, Werner Geyer, Julio Gonzalo, Tsvi Kuflik, Krister Lindén
, Bernardo Magnini, Jian-Yun Nie, Raffaele Perego
, Bracha Shapira, Ian Soboroff, Nava Tintarev, Karin Verspoor, Martijn C. Willemsen
, Justin Zobel:
From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442). Dagstuhl Manifestos 7(1): 96-139 (2018) - [j24]Ian Soboroff, Audrey Tong:
Preface. Mach. Transl. 32(1-2): 1-2 (2018) - [j23]Audrey Tong
, Lukas L. Diduch, Jonathan G. Fiscus, Yasaman Haghpanah, Shudong Huang, David Joy, Kay Peterson, Ian Soboroff:
Overview of the NIST 2016 LoReHLT evaluation. Mach. Transl. 32(1-2): 11-30 (2018) - [j22]Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, Joseph A. Konstan, Pablo Castells, Elizabeth M. Daly, Thierry Declerck, Michael D. Ekstrand, Werner Geyer, Julio Gonzalo, Tsvi Kuflik, Krister Lindén, Bernardo Magnini, Jian-Yun Nie, Raffaele Perego, Bracha Shapira, Ian Soboroff, Nava Tintarev, Karin Verspoor, Martijn C. Willemsen
, Justin Zobel:
The Dagstuhl Perspectives Workshop on Performance Modeling and Prediction. SIGIR Forum 52(1): 91-101 (2018) - [j21]Nicola Ferro, Ian Soboroff:
Report on EVIA 2017. SIGIR Forum 52(1): 162-166 (2018) - [j20]Ian Soboroff, Nicola Ferro, Norbert Fuhr:
Report on GLARE 2018: 1st Workshop on Generalization in Information Retrieval. SIGIR Forum 52(2): 132-137 (2018) - 2017
- [j19]Ellen M. Voorhees
, Daniel Samarov, Ian Soboroff:
Using Replicates in Information Retrieval Evaluation. ACM Trans. Inf. Syst. 36(2): 12:1-12:21 (2017) - 2015
- [j18]Grace Hui Yang, Ian Soboroff:
Privacy Preserving IR 2015: A SIGIR 2015 Workshop. SIGIR Forum 49(2): 98-101 (2015) - 2014
- [j17]Ellen M. Voorhees
, Paul Over, Ian Soboroff:
Building Better Search Engines by Measuring Search Quality. IT Prof. 16(2): 22-30 (2014) - 2013
- [j16]Tetsuya Sakai, Noriko Kando
, Craig Macdonald, Ian Soboroff:
Introduction to the special issue on search intents and diversification. Inf. Retr. 16(4): 427-428 (2013) - 2012
- [j15]Rodrygo L. T. Santos
, Craig Macdonald, Richard McCreadie, Iadh Ounis
, Ian Soboroff:
Information Retrieval on the Blogosphere. Found. Trends Inf. Retr. 6(1): 1-125 (2012) - 2010
- [j14]Craig Macdonald, Rodrygo L. T. Santos
, Iadh Ounis, Ian Soboroff:
Blog track research at TREC. SIGIR Forum 44(1): 58-75 (2010) - 2009
- [j13]Ian Soboroff:
A guide to the RIA workshop data archive. Inf. Retr. 12(6): 642-651 (2009) - [j12]Eugene Agichtein, Marti A. Hearst, Ian Soboroff:
The search and social media workshop at SIGIR 2009. SIGIR Forum 43(2): 53-56 (2009) - 2007
- [j11]Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen M. Voorhees
:
Bias and the limits of pooling for large collections. Inf. Retr. 10(6): 491-508 (2007) - [j10]Peter Bailey, Nick Craswell, Ian Soboroff, Arjen P. de Vries:
The CSIRO enterprise search test collection. SIGIR Forum 41(2): 42-45 (2007) - 2005
- [j9]Charles L. A. Clarke, Nick Craswell, Ian Soboroff:
The TREC terabyte retrieval track. SIGIR Forum 39(1): 25 (2005) - [j8]David Carmel, Elad Yom-Tov, Ian Soboroff:
SIGIR workshop report: predicting query difficulty - methods and applications. SIGIR Forum 39(2): 25-28 (2005) - 2003
- [j7]Ian Soboroff, Ellen M. Voorhees, Nick Craswell:
Summary of the SIGIR 2003 workshop on defining evaluation methodologies for terabyte-scale test collections. SIGIR Forum 37(2): 55-58 (2003) - 2002
- [j6]R. Scott Cost, Timothy W. Finin
, Anupam Joshi
, Yun Peng, Charles K. Nicholas, Ian Soboroff, Harry Chen, Lalana Kagal, Filip Perich, Youyong Zou, Sovrin Tolia:
ITtalks: A Case Study in the Semantic Web and DAML+OIL. IEEE Intell. Syst. 17(1): 40-47 (2002) - [j5]Ian Soboroff, Charles K. Nicholas:
Related, but not Relevant: Content-Based Collaborative Filtering in TREC-8. Inf. Retr. 5(2-3): 189-208 (2002) - [j4]Ian Soboroff:
Do TREC web collections look like the web? SIGIR Forum 36(2): 23-31 (2002) - 1999
- [j3]Christopher D. Shaw
, James M. Kukla, Ian Soboroff, David S. Ebert, Charles K. Nicholas, Amen Zwa, Ethan L. Miller, D. Aaron Roberts:
Interactive Volumetric Information Visualization for Document Corpus Management. Int. J. Digit. Libr. 2(2-3): 144-156 (1999) - [j2]Ian Soboroff, Charles K. Nicholas, Michael J. Pazzani:
Workshop on Recommender Systems: Algorithms and Evaluation. SIGIR Forum 33(1): 36-43 (1999) - 1996
- [j1]Russell Turner, Enrico Gobbetti
, Ian Soboroff:
Head-Tracked Stereo Viewing with Two-Handed 3D Interactionfor Animated Character Construction. Comput. Graph. Forum 15(3): 197-206 (1996)
Conference and Workshop Papers
- 2024
- [c101]Timo Breuer
, Ellen M. Voorhees
, Ian Soboroff
:
Browsing and Searching Metadata of TREC. SIGIR 2024: 313-323 - [c100]James Mayfield
, Eugene Yang
, Dawn J. Lawrie
, Sean MacAvaney
, Paul McNamee
, Douglas W. Oard
, Luca Soldaini
, Ian Soboroff
, Orion Weller
, Efsun Selin Kayi, Kate Sanders
, Marc Mason
, Noah Hibbler
:
On the Evaluation of Machine-Generated Reports. SIGIR 2024: 1904-1915 - 2023
- [c99]Keith Curtis
, George Awad
, Afzal Godil, Ian Soboroff
:
The ACM Multimedia 2023 Deep Video Understanding Grand Challenge. ACM Multimedia 2023: 9606-9609 - [c98]Ian Soboroff
:
The BETTER Cross-Language Datasets. SIGIR 2023: 3047-3053 - 2022
- [c97]Gareth J. F. Jones, Maria Eskevich, Ben Carterette, Joana Correia, Rosie Jones, Jussi Karlgren
, Ian Soboroff:
CHIIR Workshop on Audio Collection Human Interaction (AudioCHI 2022): http: //speechretrievalworkshop.github.io. CHIIR 2022: 377-378 - [c96]Keith Curtis
, George Awad, Shahzad Rajput, Ian Soboroff:
Second International Workshop on Deep Video Understanding. ICMI 2022: 801-802 - [c95]Cody Buntain, Richard McCreadie, Ian Soboroff:
Incident Streams 2021 Off the Deep End: Deeper Annotations and Evaluations in Twitter. ISCRAM 2022: 584-604 - [c94]Keith Curtis, George Awad, Shahzad Rajput, Ian Soboroff:
The ACM Multimedia 2022 Deep Video Understanding Grand Challenge. ACM Multimedia 2022: 7075-7078 - [c93]Rezvaneh Rezapour, Sravana Reddy, Rosie Jones, Ian Soboroff:
What Makes a Good Podcast Summary? SIGIR 2022: 2039-2046 - [c92]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, Ian Soboroff:
Overview of the TREC 2022 Deep Learning Track. TREC 2022 - 2021
- [c91]Cody Buntain, Richard McCreadie, Ian Soboroff:
Incident Streams 2020: TRECIS in the Time of COVID-19. ISCRAM 2021: 621-639 - [c90]Ben Carterette, Rosie Jones, Gareth J. F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren
, Ian Soboroff:
Podcast Metadata and Content: Episode Relevance and Attractiveness in Ad Hoc Search. SIGIR 2021: 2247-2251 - [c89]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff:
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. SIGIR 2021: 2369-2375 - [c88]Ian Soboroff:
Overview of TREC 2021. TREC 2021 - 2020
- [c87]Keith Curtis
, George Awad, Shahzad Rajput, Ian Soboroff:
International Workshop on Deep Video Understanding. ICMI 2020: 871-873 - [c86]Richard McCreadie, Cody Buntain, Ian Soboroff:
Incident Streams 2019: Actionable Insights and How to Find Them. ISCRAM 2020: 744-760 - [c85]Keith Curtis
, George Awad, Shahzad Rajput, Ian Soboroff:
HLVU: A New Challenge to Test Deep Understanding of Movies the Way Humans do. ICMR 2020: 355-361 - [c84]Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro
, Tetsuya Sakai, Philipp Schaer, Ian Soboroff:
How to Measure the Reproducibility of System-oriented IR Experiments. SIGIR 2020: 349-358 - [c83]Cody Buntain, Richard McCreadie, Ian Soboroff:
Incident Streams 2020: TRECIS in the Time of COVID-19. TREC 2020 - [c82]Ian Soboroff, Shudong Huang, Donna Harman:
TREC 2020 News Track Overview. TREC 2020 - 2019
- [c81]Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff:
CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks. CLEF (Working Notes) 2019 - [c80]Nicola Ferro, Norbert Fuhr, Maria Maistro
, Tetsuya Sakai, Ian Soboroff:
Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. CLEF 2019: 287-300 - [c79]Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff:
CENTRE@CLEF 2019. ECIR (2) 2019: 283-290 - [c78]Nicola Ferro, Ian Soboroff, Min Zhang:
EVIA 2019 Preface. EVIA@NTCIR 2019 - [c77]Richard McCreadie, Cody Buntain, Ian Soboroff:
TREC Incident Streams: Finding Actionable Information on Social Media. ISCRAM 2019 - [c76]Louiqa Raschid, Douglas Burdick, Cesar de Pablo, Mark D. Flood
, John Grant, Joe Langsam, Jay Pujara, Elena Tomas, Ian Soboroff:
Financial Entity Identification and Information Integration (FEIII) 2019 Challenge: The Report of the Organizing Committee. DSMM@SIGMOD 2019: 6:1-6:3 - 2018
- [c75]Ian Soboroff:
Meta-Analysis for Retrieval Experiments Involving Multiple Test Collections. CIKM 2018: 713-722 - [c74]Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff:
CENTRE@CLEF2018: Overview of the Replicability Task. CLEF (Working Notes) 2018 - [c73]Nicola Ferro, Maria Maistro
, Tetsuya Sakai, Ian Soboroff:
Overview of CENTRE@CLEF 2018: A First Tale in the Systematic Reproducibility Realm. CLEF 2018: 239-246 - [c72]Shudong Huang, Ian Soboroff, Donna Harman:
TREC 2018 News Track. NewsIR@ECIR 2018: 57-59 - [c71]Louiqa Raschid, Douglas Burdick, John Grant, Joe Langsam, Jay Pujara, Elizabeth Roman, Ian Soboroff, Mohammed J. Zaki, Elena Zotkina:
Financial Entity Identification and Information Integration (FEIII) 2018 Challenge: The Report of the Organizing Committee. DSMM@SIGMOD 2018: 9:1-9:3 - [c70]Ian Soboroff, Shudong Huang, Donna Harman:
TREC 2018 News Track Overview. TREC 2018 - 2017
- [c69]Ian Soboroff:
New Tracks for TREC 2018. NTCIR 2017 - [c68]Ian Soboroff:
Building Test Collections: An Interactive Guide for Students and Others Without Their Own Evaluation Conference Series. SIGIR 2017: 1407-1410 - [c67]Louiqa Raschid, Douglas Burdick, Mark D. Flood
, John Grant, Joe Langsam, Ian Soboroff:
Financial Entity Identification and Information Integration (FEIII) 2017 Challenge: The Report of the Organizing Committee. DSMM@SIGMOD 2017: 1:1-1:4 - [c66]Grace Hui Yang, Zhiwen Tang, Ian Soboroff:
TREC 2017 Dynamic Domain Track Overview. TREC 2017 - 2016
- [c65]Mark D. Flood, John Grant, Haiping Luo, Louiqa Raschid, Ian Soboroff, Kyungjin Yoo:
Financial Entity Identification and Information Integration (FEIII) Challenge: The Report of the Organizing Committee. DSMM@SIGMOD 2016: 1:1-1:4 - [c64]Ian Soboroff:
News from TREC. NTCIR 2016 - [c63]Ellen M. Voorhees, Shahzad Rajput, Ian Soboroff:
Promoting Repeatability Through Open Runs. EVIA@NTCIR 2016 - [c62]Ian Soboroff, Kira Griffitt, Stephanie M. Strassel:
The BOLT IR Test Collections of Multilingual Passage Retrieval from Discussion Forums. SIGIR 2016: 713-716 - [c61]Grace Hui Yang, Ian Soboroff, Li Xiong
, Charles L. A. Clarke, Simson L. Garfinkel
:
Privacy-Preserving IR 2016: Differential Privacy, Search, and Social Media. SIGIR 2016: 1247-1248 - [c60]Grace Hui Yang, Ian Soboroff:
TREC 2016 Dynamic Domain Track Overview. TREC 2016 - 2015
- [c59]Hui Yang, Ian Soboroff:
Privacy-Preserving IR 2015: When Information Retrieval Meets Privacy and Security. SIGIR 2015: 1157-1158 - [c58]Hui Yang, John R. Frank, Ian Soboroff:
TREC 2015 Dynamic Domain Track Overview. TREC 2015 - 2014
- [c57]Ian Soboroff:
Computing Confidence Intervals for Common IR Measures. EVIA@NTCIR 2014 - [c56]John R. Frank, Max Kleiman-Weiner, Daniel A. Roberts, Ellen M. Voorhees, Ian Soboroff:
Evaluating Stream Filtering for Entity Profile Updates in TREC 2012, 2013, and 2014. TREC 2014 - 2013
- [c55]Ian Soboroff:
Building test collections: an interactive tutorial for students and others without their own evaluation conference series. SIGIR 2013: 1132 - [c54]John R. Frank, Steven J. Bauer, Max Kleiman-Weiner, Daniel A. Roberts, Nilesh Tripuraneni, Ce Zhang, Christopher Ré, Ellen M. Voorhees, Ian Soboroff:
Evaluating Stream Filtering for Entity Profile Updates for TREC 2013. TREC 2013 - 2012
- [c53]Richard McCreadie, Ian Soboroff, Jimmy Lin, Craig Macdonald, Iadh Ounis
, Dean McCullough:
On building a reusable Twitter corpus. SIGIR 2012: 1113-1114 - [c52]John R. Frank, Max Kleiman-Weiner, Daniel A. Roberts, Feng Niu, Ce Zhang, Christopher Ré, Ian Soboroff:
Building an Entity-Centric Stream Filtering Test Collection for TREC 2012. TREC 2012 - [c51]Ian Soboroff, Iadh Ounis, Craig Macdonald, Jimmy Lin:
Overview of the TREC-2012 Microblog Track. TREC 2012 - 2011
- [c50]Mark Sanderson, William Webber, Ian Soboroff, Gareth J. F. Jones, Andrew Trotman, Shlomo Geva, Nicola Ferro, Hideo Joho:
Reports from Other Evaluation Campaigns and Panel Discussion: TREC is 20 Years Old, Where Now for Evaluation Campaigns? EVIA@NTCIR 2011 - [c49]Charles L. A. Clarke, Nick Craswell, Ian Soboroff, Ellen M. Voorhees:
Overview of the TREC 2011 Web Track. TREC 2011 - [c48]Iadh Ounis, Craig Macdonald, Jimmy Lin, Ian Soboroff:
Overview of the TREC 2011 Microblog Track. TREC 2011 - [c47]Charles L. A. Clarke, Nick Craswell, Ian Soboroff, Azin Ashkan:
A comparative analysis of cascade measures for novelty and diversity. WSDM 2011: 75-84 - 2010
- [c46]Ian Soboroff:
Test Collection Diagnosis and Treatment. EVIA@NTCIR 2010: 34-41 - [c45]Ben Carterette, Ian Soboroff:
The effect of assessor error on IR system evaluation. SIGIR 2010: 539-546 - [c44]Charles L. A. Clarke, Nick Craswell, Ian Soboroff, Gordon V. Cormack:
Overview of the TREC 2010 Web Track. TREC 2010 - [c43]Iadh Ounis, Ian Soboroff:
Overview of the TREC 2010 Blog Track. TREC 2010 - 2009
- [c42]Craig Macdonald, Iadh Ounis
, Ian Soboroff:
Is spam an issue for opinionated blog post search? SIGIR 2009: 710-711 - [c41]Charles L. A. Clarke, Nick Craswell, Ian Soboroff:
Overview of the TREC 2009 Web Track. TREC 2009 - [c40]Craig Macdonald, Iadh Ounis, Ian Soboroff:
Overview of the TREC 2009 Blog Track. TREC 2009 - 2008
- [c39]Iadh Ounis, Craig Macdonald, Ian Soboroff:
On the TREC Blog Track. ICWSM 2008 - [c38]Ian Soboroff:
TREC, TAC, takeoffs, tacks, tasks, and titillations for 2009. NTCIR 2008 - [c37]Peter Bailey, Nick Craswell, Ian Soboroff, Paul Thomas
, Arjen P. de Vries
, Emine Yilmaz:
Relevance assessment: are judges exchangeable and does it matter. SIGIR 2008: 667-674 - [c36]Craig Macdonald, Ben He, Iadh Ounis
, Ian Soboroff:
Limits of opinion-finding baseline systems. SIGIR 2008: 747-748 - [c35]Krisztian Balog, Ian Soboroff, Paul Thomas, Peter Bailey, Nick Craswell, Arjen P. de Vries:
Overview of the TREC 2008 Enterprise Track. TREC 2008 - [c34]Iadh Ounis, Craig MacDonald, Ian Soboroff:
Overview of the TREC 2008 Blog Track. TREC 2008 - 2007
- [c33]Ian Soboroff:
What's New at TREC: Blog and Legal Discovery Search at TREC-2006. NTCIR 2007 - [c32]Ian Soboroff:
A Comparison of Pooled and Sampled Relevance Judgments in the TREC 2006 Terabyte Track. EVIA@NTCIR 2007 - [c31]Stefan Büttcher, Charles L. A. Clarke, Peter C. K. Yeung, Ian Soboroff:
Reliable information retrieval evaluation with incomplete and biased judgements. SIGIR 2007: 63-70 - [c30]Ian Soboroff:
A comparison of pooled and sampled relevance judgments. SIGIR 2007: 785-786 - [c29]Mark Sanderson
, Ian Soboroff:
Problems with Kendall's tau. SIGIR 2007: 839-840 - [c28]Peter Bailey, Arjen P. de Vries, Nick Craswell, Ian Soboroff:
Overview of the TREC 2007 Enterprise Track. TREC 2007 - [c27]Craig Macdonald, Iadh Ounis, Ian Soboroff:
Overview of the TREC 2007 Blog Track. TREC 2007 - 2006
- [c26]Yejun Wu, Douglas W. Oard, Ian Soboroff:
An Exploratory Study of the W3C Mailing List Test Collection for Retrieval of Emails with Pro/Con Argument. CEAS 2006 - [c25]Ian Soboroff:
Dynamic test collections: measuring search effectiveness on the live web. SIGIR 2006: 276-283 - [c24]Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen M. Voorhees
:
Bias and the limits of pooling. SIGIR 2006: 619-620 - [c23]Stefan Büttcher, Charles L. A. Clarke, Ian Soboroff:
The TREC 2006 Terabyte Track. TREC 2006 - [c22]Iadh Ounis, Craig Macdonald, Maarten de Rijke, Gilad Mishne, Ian Soboroff:
Overview of the TREC 2006 Blog Track. TREC 2006 - [c21]Ian Soboroff, Arjen P. de Vries, Nick Craswell:
Overview of the TREC 2006 Enterprise Track. TREC 2006 - 2005
- [c20]Ian Soboroff, Donna Harman:
Novelty Detection: The TREC Experience. HLT/EMNLP 2005: 105-112 - [c19]Charles L. A. Clarke, Falk Scholer, Ian Soboroff:
The TREC 2005 Terabyte Track. TREC 2005 - [c18]Nick Craswell, Arjen P. de Vries, Ian Soboroff:
Overview of the TREC 2005 Enterprise Track. TREC 2005 - 2004
- [c17]Ian Soboroff:
On evaluating web search with very few relevant documents. SIGIR 2004: 530-531 - [c16]Charles L. A. Clarke, Nick Craswell, Ian Soboroff:
Overview of the TREC 2004 Terabyte Track. TREC 2004 - [c15]Ian Soboroff:
Overview of the TREC 2004 Novelty Track. TREC 2004 - 2003
- [c14]Ian Soboroff, Stephen E. Robertson:
Building a filtering test collection for TREC 2002. SIGIR 2003: 243-250 - [c13]Ian Soboroff, Donna Harman:
Overview of the TREC 2003 Novelty Track. TREC 2003: 38-53 - 2002
- [c12]Abdur Chowdhury, Ian Soboroff:
Automatic evaluation of world wide web search services. SIGIR 2002: 421-422 - [c11]Ian Soboroff:
Does WT10g look like the web?. SIGIR 2002: 423-424 - [c10]Stephen E. Robertson, Ian Soboroff:
The TREC 2002 Filtering Track Report. TREC 2002 - 2001
- [c9]Ian Soboroff, Charles K. Nicholas, Patrick Cahan:
Ranking Retrieval Systems without Relevance Judgments. SIGIR 2001: 66-73 - [c8]Stephen E. Robertson, Ian Soboroff:
The TREC 2001 Filtering Track Report. TREC 2001 - 2000
- [c7]Ian Soboroff, Charles K. Nicholas:
Collaborative filtering and the generalized vector space model. SIGIR 2000: 351-353 - 1999
- [c6]R. Scott Cost, Timothy W. Finin, Yannis Labrou, Xiaocheng Luan, Yun Peng, Ian Soboroff, James Mayfield, Akram Boughannam:
Agent Development with Jackal. Agents 1999: 358-359 - [c5]R. Scott Cost, Timothy W. Finin, Yannis Labrou, Xiaocheng Luan, Yun Peng, Ian Soboroff, James Mayfield, Akram Boughannam:
An Agent-Based Infrastructure for Enterprise Integration. ASA/MA 1999: 219-233 - [c4]Douglas W. Oard, Jianqiang Wang, Dekang Lin, Ian Soboroff:
TREC-8 Experiments at Maryland: CLIR, QA and Routing. TREC 1999 - 1997
- [c3]R. Scott Cost, Ian Soboroff, Jeegar Lakhani, Timothy W. Finin, Ethan L. Miller, Charles K. Nicholas:
TKQML: A Scripting Tool for Building Agents. ATAL 1997: 339-343 - [c2]Ian Soboroff, Charles K. Nicholas, James M. Kukla, David S. Ebert:
Visualizing Document Authorship Using n-grams and Latent Semantic Indexing. Workshop on New Paradigms in Information Visualization and Manipulation 1997: 43-48 - [c1]R. Scott Cost, Ian Soboroff, Jeegar Lakhani, Tim Finin, Ethan L. Miller, Charles K. Nicholas:
Agent Development Support for Tcl. Tcl/Tk Workshop 1997
Editorship
- 2022
- [e7]Ian Soboroff, Angela Ellis:
Proceedings of the Thirty-First Text REtrieval Conference, TREC 2022, online, November 15-19, 2022. NIST Special Publication 500-338, National Institute of Standards and Technology (NIST) 2022 [contents] - 2021
- [e6]Ian Soboroff, Angela Ellis:
Proceedings of the Thirtieth Text REtrieval Conference, TREC 2021, online, November 15-19, 2021. NIST Special Publication 500-335, National Institute of Standards and Technology (NIST) 2021 [contents] - 2019
- [e5]Nicola Ferro, Ian Soboroff, Min Zhang:
Proceedings of the 9th International Workshop on Evaluating Information Access co-located with the 14th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2019), Tokyo, Japan, June 10, 2019. 2019 [contents] - 2017
- [e4]Nicola Ferro, Ian Soboroff:
Proceedings of the 8th International Workshop on Evaluating Information Access co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR 2017), Tokyo, Japan, December 5, 2017. CEUR Workshop Proceedings 2008, CEUR-WS.org 2017 [contents] - 2014
- [e3]Jianzhong Li, Xiaoyang Sean Wang, Minos N. Garofalakis, Ian Soboroff, Torsten Suel, Min Wang:
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, CIKM 2014, Shanghai, China, November 3-7, 2014. ACM 2014, ISBN 978-1-4503-2598-1 [contents] - 2013
- [e2]Emre Kiciman, Nicole B. Ellison, Bernie Hogan, Paul Resnick, Ian Soboroff:
Proceedings of the Seventh International Conference on Weblogs and Social Media, ICWSM 2013, Cambridge, Massachusetts, USA, July 8-11, 2013. The AAAI Press 2013, ISBN 978-1-57735-610-3 [contents] - 2008
- [e1]Ian Soboroff, Eugene Agichtein, Ravi Kumar:
Proceeding of the 2008 ACM Workshop on Search in Social Media, SSM 2008, Napa Valley, California, USA, October 30, 2008. ACM 2008, ISBN 978-1-60558-258-0 [contents]
Informal and Other Publications
- 2024
- [i11]James Mayfield, Eugene Yang, Dawn J. Lawrie, Sean MacAvaney, Paul McNamee, Douglas W. Oard, Luca Soldaini, Ian Soboroff, Orion Weller, Efsun Selin Kayi, Kate Sanders, Marc Mason, Noah Hibbler:
On the Evaluation of Machine-Generated Reports. CoRR abs/2405.00982 (2024) - [i10]Somnath Banerjee, Avik Halder, Rajarshi Mandal, Sayan Layek, Ian Soboroff, Rima Hazra, Animesh Mukherjee:
Breaking Boundaries: Investigating the Effects of Model Editing on Cross-linguistic Performance. CoRR abs/2406.11139 (2024) - 2022
- [i9]Ellen M. Voorhees, Ian Soboroff, Jimmy Lin:
Can Old TREC Collections Reliably Evaluate Modern Neural Retrieval Models? CoRR abs/2201.11086 (2022) - [i8]Tetsuya Sakai, Sijie Tao, Maria Maistro, Zhumin Chu, Yujing Li, Nuo Chen, Nicola Ferro, Junjie Wang, Ian Soboroff, Yiqun Liu:
Corrected Evaluation Results of the NTCIR WWW-2, WWW-3, and WWW-4 English Subtasks. CoRR abs/2210.10266 (2022) - 2021
- [i7]Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff:
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. CoRR abs/2104.09399 (2021) - [i6]Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh:
Searching for Scientific Evidence in a Pandemic: An Overview of TREC-COVID. CoRR abs/2104.09632 (2021) - [i5]Ben Carterette, Rosie Jones, Gareth J. F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren, Ian Soboroff:
Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search. CoRR abs/2108.11460 (2021) - 2020
- [i4]Keith Curtis, George Awad, Shahzad Rajput, Ian Soboroff:
HLVU : A New Challenge to Test Deep Understanding of Movies the Way Humans do. CoRR abs/2005.00463 (2020) - [i3]Ellen M. Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang
:
TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection. CoRR abs/2005.04474 (2020) - [i2]Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, Ian Soboroff:
How to Measure the Reproducibility of System-oriented IR Experiments. CoRR abs/2010.13447 (2020) - 2019
- [i1]Heng Ji, Avirup Sil, Hoa Trang Dang, Ian Soboroff, Joel Nothman:
Overview of TAC-KBP 2019 Fine-grained Entity Extraction. TAC 2019
Coauthor Index
![](https://dblp.uni-trier.de/img/cog.dark.24x24.png)
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from ,
, and
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and
to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from .
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-08-18 00:33 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint