default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDIvan Stelmakh
Person information
- affiliation: Carnegie Mellon University, Pittsburgh, PA, USA
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
Journal Articles
- 2021
[j2]Ivan Stelmakh, Nihar B. Shah, Aarti Singh:
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review. J. Mach. Learn. Res. 22: 163:1-163:66 (2021)- [j1]Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III:
Prior and Prejudice: The Novice Reviewers' Bias against Resubmissions in Conference Peer Review. Proc. ACM Hum. Comput. Interact. 5(CSCW1): 75:1-75:17 (2021)
Conference and Workshop Papers
- 2022
- [c10]Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, Ming-Wei Chang:
ASQA: Factoid Questions Meet Long-Form Answers. EMNLP 2022: 8273-8288 - [c9]Charvi Rastogi, Ivan Stelmakh, Nihar B. Shah, Sivaraman Balakrishnan:
No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise. ISIT 2022: 3168-3173 - 2021
- [c8]Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III:
A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences. AAAI 2021: 4785-4793 - [c7]Ivan Stelmakh, Nihar B. Shah, Aarti Singh:
Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment. AAAI 2021: 4794-4802 - [c6]Jingyan Wang, Ivan Stelmakh, Yuting Wei, Nihar B. Shah:
Debiasing Evaluations That Are Biased by Evaluations. AAAI 2021: 10120-10128 - [c5]Ivan Stelmakh:
Towards Fair, Equitable, and Efficient Peer Review. AAAI 2021: 15736-15737 - [c4]Dmitry Ustalov, Nikita Pavlichenko, Ivan Stelmakh, Dmitriy Kuznetsov:
VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions. CSW@VLDB 2021: 1-7 - [c3]Nikita Pavlichenko, Ivan Stelmakh, Dmitry Ustalov:
CrowdSpeech and Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription. NeurIPS Datasets and Benchmarks 2021 - 2019
- [c2]Ivan Stelmakh, Nihar B. Shah, Aarti Singh:
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review. ALT 2019: 827-855 - [c1]Ivan Stelmakh, Nihar B. Shah, Aarti Singh:
On Testing for Biases in Peer Review. NeurIPS 2019: 5287-5297
Editorship
- 2021
- [e1]Dmitry Ustalov, Fabio Casati, Alexey Drutsa, Ivan Stelmakh, Nikita Pavlichenko, Daria Baidakova:
Proceedings of the 2nd Crowd Science Workshop: Trust, Ethics, and Excellence in Crowdsourced Data Management at Scale co-located with 47th International Conference on Very Large Data Bases (VLDB 2021), Copenhagen, Denmark, August 20, 2021. CEUR Workshop Proceedings 2932, CEUR-WS.org 2021 [contents]
Informal and Other Publications
- 2024
- [i14]Charvi Rastogi, Xiangchen Song, Zhijing Jin, Ivan Stelmakh, Hal Daumé III, Kun Zhang, Nihar B. Shah:
A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussions. CoRR abs/2403.01015 (2024) - 2023
- [i13]Ivan Stelmakh, John Wieting, Graham Neubig, Nihar B. Shah:
A Gold Standard Dataset for the Reviewer Assignment Problem. CoRR abs/2303.16750 (2023) - [i12]Alexander Goldberg, Ivan Stelmakh, Kyunghyun Cho, Alice H. Oh, Alekh Agarwal, Danielle Belgrave, Nihar B. Shah:
Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments. CoRR abs/2311.09497 (2023) - 2022
- [i11]Ivan Stelmakh, Charvi Rastogi, Ryan Liu, Shuchi Chawla, Federico Echenique, Nihar B. Shah:
Cite-seeing and Reviewing: A Study on Citation Bias in Peer Review. CoRR abs/2203.17239 (2022) - [i10]Charvi Rastogi, Ivan Stelmakh, Xinwei Shen, Marina Meila, Federico Echenique, Shuchi Chawla, Nihar B. Shah:
To ArXiv or not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online. CoRR abs/2203.17259 (2022) - [i9]Ivan Stelmakh, Yi Luan, Bhuwan Dhingra, Ming-Wei Chang:
ASQA: Factoid Questions Meet Long-Form Answers. CoRR abs/2204.06092 (2022) - [i8]Charvi Rastogi, Ivan Stelmakh, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, Zhenyu Xue, Hal Daumé III, Emma Pierson, Nihar B. Shah:
How do Authors' Perceptions of their Papers Compare with Co-authors' Perceptions and Peer-review Decisions? CoRR abs/2211.12966 (2022) - 2021
- [i7]Nikita Pavlichenko, Ivan Stelmakh, Dmitry Ustalov:
Vox Populi, Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription. CoRR abs/2107.01091 (2021) - 2020
- [i6]Ivan Stelmakh, Nihar B. Shah, Aarti Singh:
Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment. CoRR abs/2010.04041 (2020) - [i5]Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III:
Prior and Prejudice: The Novice Reviewers' Bias against Resubmissions in Conference Peer Review. CoRR abs/2011.14646 (2020) - [i4]Ivan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé III:
A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences. CoRR abs/2011.15050 (2020) - [i3]Ivan Stelmakh, Charvi Rastogi, Nihar B. Shah, Aarti Singh, Hal Daumé III:
A Large Scale Randomized Controlled Trial on Herding in Peer-Review Discussions. CoRR abs/2011.15083 (2020) - [i2]Jingyan Wang, Ivan Stelmakh, Yuting Wei, Nihar B. Shah:
Debiasing Evaluations That are Biased by Evaluations. CoRR abs/2012.00714 (2020) - 2018
- [i1]Ivan Stelmakh, Nihar B. Shah, Aarti Singh:
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review. CoRR abs/1806.06237 (2018)
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from 
to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the 
of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from 
, 
, and 
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from 
.
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-10-16 21:25 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by:
