This presentation was provided by Kyle Lo of The Allen Institute for AI (AI2) during the NISO hot topic event "Preprints." The virtual conference was held on April 21, 2021.
Visit to a blind student's school🧑🦯🧑🦯(community medicine)
Lo "AI-infused interfaces for reading AI preprints"
1. AI-infused interfaces for
reading AI preprints
Kyle Lo
Semantic Scholar Research, Allen Institute for Artificial Intelligence
NISO 2021
April 21, 2021
2. Preprints
High volume. Variable quality (no peer review).
Metadata complications. Faster dissemination of research.
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
3. Preprints
High volume. Variable quality (no peer review).
Metadata complications. Faster dissemination of research.
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
4. Preprints
High volume. Variable quality (no peer review).
Metadata complications. Faster dissemination of research.
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
5. Preprints
High volume. Variable quality (no peer review).
Metadata complications. Faster dissemination of research.
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
6. Preprints
High volume. Variable quality (no peer review).
Metadata complications. Faster dissemination of research.
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
7. arXiv
The AI research community’s relationship with preprints
Improving the reading experience for arXiv preprints
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
8. arXiv
The AI research community’s relationship with preprints
Improving the reading experience for arXiv preprints
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
9. arXiv
The AI research community’s relationship with preprints
Improving the reading experience for arXiv preprints
Keeping up-to-date
Passive. Recommendation. Habit. Little at a time.
42. 4. Incentives for preprinting on arXiv
“... papers that were eventually accepted for publication
at top-tier CS conferences, and were posted on arXiv
either before or after the acceptance notification…”
43. 4. Incentives for preprinting on arXiv
“...papers submitted to arXiv before acceptance have, on
average, 65% more citations in the following year
compared to papers submitted after…”
44. 5. arXiv policies for top AI conferences
Q: Is arXiv preprinting allowed?
“Submission of the paper to archival repositories such as arXiv are allowed.” - ICLR 2020
”For arXiv submissions, <date> is the submission deadline” - ACL 2020
45. Q: Does my submission need to cite arXiv papers that are related to my work?
“Consistent with good academic practice, the authors should cite all sources that
inspired and informed their work. This said, asking authors to thoroughly compare their
work with arXiv reports that appeared shortly before the submission deadline imposes
an unreasonable burden.” - CVPR 2020
5. arXiv policies for top AI conferences
46. Lots of reasons to:
Submit papers to arXiv
+
Keep up-to-date with arXiv
70. Conclusion
Reading preprints is part of normal research workflow
Invest in tools to help with all aspects of doing research
beyond search & discovery
Open data can be unexpectedly helpful for tool development
71. Thanks!
kylel@allenai.org
@kylelostat
Head, Andrew, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld and Marti A. Hearst.
“Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols.”
ArXiv (2020). To appear at CHI 2020.